-- Logs begin at Wed 2022-08-24 15:51:40 UTC, end at Wed 2022-08-24 17:05:27 UTC. -- Aug 24 16:35:36.687587 dv-cinder-731167-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 16:35:36.694882 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 16:35:36 2022] *** Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: nodename: dv-cinder-731167-2-iscsi Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: machine: x86_64 Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: clock source: unix Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: pcre jit disabled Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: detected number of CPU cores: 4 Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: current working directory: / Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: detected binary path: /usr/bin/uwsgi-core Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: your processes number limit is 47680 Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: your memory page size is 4096 bytes Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: detected max file descriptor number: 2048 Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: lock engine: pthread robust mutexes Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: thunder lock: enabled Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 16:35:36.700283 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 16:35:36.737574 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: Python main interpreter initialized at 0x55e9a37a89c0 Aug 24 16:35:36.737574 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: python threads support enabled Aug 24 16:35:36.737574 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: your server socket listen backlog is limited to 100 connections Aug 24 16:35:36.737574 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: your mercy for graceful operations on workers is 90 seconds Aug 24 16:35:36.737957 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 16:35:36.738042 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: *** Operational MODE: preforking *** Aug 24 16:35:36.738241 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: *** uWSGI is running in multiple interpreter mode *** Aug 24 16:35:36.738241 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: spawned uWSGI master process (pid: 112583) Aug 24 16:35:36.738449 dv-cinder-731167-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 16:35:36.739566 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: spawned uWSGI worker 1 (pid: 112584, cores: 1) Aug 24 16:35:36.739566 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: spawned uWSGI worker 2 (pid: 112585, cores: 1) Aug 24 16:35:36.739566 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 16:35:37.416913 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:35:37.447919 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:35:38.517594 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:35:38.517594 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: from cryptography.utils import int_from_bytes Aug 24 16:35:38.518800 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:35:38.518800 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: from cryptography.utils import int_from_bytes Aug 24 16:35:38.527485 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:35:38.527485 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: from cryptography.utils import int_from_bytes Aug 24 16:35:38.527915 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:35:38.527915 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: from cryptography.utils import int_from_bytes Aug 24 16:35:41.018925 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:35:41.019484 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:35:41.019484 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:35:41.019911 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:35:41.019911 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:35:41.020059 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:35:41.020148 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:35:41.020229 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:35:41.020305 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:35:41.020418 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:35:41.020659 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.020776 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.020979 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.021076 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.021297 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.021383 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.021611 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.021715 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.021936 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.022030 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.022243 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.022329 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.022819 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.022982 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.023132 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.023219 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.023456 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.023571 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.023711 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.023810 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.024020 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.024123 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.024360 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-731167-2-iscsi {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.024470 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-731167-2-iscsi {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.024679 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.024773 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.024982 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.025067 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.025284 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.025381 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.025595 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.025682 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.025896 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.025984 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.026213 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.026309 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.026513 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.026615 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.027002 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.027119 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.027441 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.027553 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.027745 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.027839 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.028049 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.028156 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.028402 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.028543 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.028718 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.028820 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.029018 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.029114 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.029331 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.029428 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.029635 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.029720 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.029951 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.030049 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.030257 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.030360 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.030643 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-731167-2-iscsi {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.030738 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-731167-2-iscsi {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.030955 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.031047 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.031259 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.031353 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.031570 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.031655 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.031976 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.032102 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.032306 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.032435 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.032612 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.032720 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.032927 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.033015 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.033785 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.033887 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.034277 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.034396 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.034648 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.034736 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.034970 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.035057 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.035288 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.035376 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.035607 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.035703 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.035908 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.036002 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.036213 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.036310 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.036547 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.036643 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.036862 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.036947 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.037164 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.037265 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.037464 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.037559 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.037710 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.037806 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.038011 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.038106 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.038327 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.038414 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.038644 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.038735 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.038959 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.039058 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.039208 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.039302 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.039453 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.039546 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.039766 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.039855 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.040081 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.040175 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.040403 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.040508 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.040710 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.040797 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.041012 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.041097 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.041312 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.041406 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.041614 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.041711 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.041917 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.042030 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.042216 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.042305 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.042515 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.042601 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.042834 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.042941 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.043146 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.043261 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.043466 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.043581 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.043770 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.043888 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.044089 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.044204 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.044501 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.044616 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.044753 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.044865 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.045044 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.045169 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.045381 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.045502 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.045704 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.045835 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.046009 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.046159 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.046325 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.046413 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.046640 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.046736 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.046944 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.047040 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.047248 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.047334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.047551 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.047646 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.047865 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.047959 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.048192 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.048288 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.048514 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.048616 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.048746 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.048828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.049738 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.050204 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.050464 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.050776 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.051044 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.051132 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.051379 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.051472 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.051682 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.051781 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.051990 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.052078 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.052298 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.052416 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.052630 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.052726 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.052934 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.053020 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.053240 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.053373 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.053544 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.053635 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.053849 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.053934 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.054154 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.054289 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.054453 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.054533 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.054747 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.054838 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.055054 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.055152 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.055359 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.055447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.055662 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.055751 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.055965 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.056066 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.056270 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.056402 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.056602 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.056701 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.056908 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.057008 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.057213 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.057301 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.057517 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.057610 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.057821 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.057907 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.058123 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.058211 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.058424 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.058509 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.058735 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.058874 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.059036 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.059133 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.059339 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.059428 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.059638 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.059734 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.059942 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.060027 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.060243 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.060365 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.060572 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.060676 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.060873 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.060960 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.061172 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.061259 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.061475 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.061570 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.061776 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.061862 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.062076 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.062160 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.062374 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.062468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.062672 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.062765 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.062969 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.063065 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.063267 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.063356 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.063565 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.063652 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.063864 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.063952 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.064162 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.064251 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.064487 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.064629 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.064931 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.065020 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.065184 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.065275 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.065435 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.065563 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.065737 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.065911 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.066046 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:35:41.066231 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.066369 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.066566 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.066698 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.066898 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.067038 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.067217 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.067351 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.067533 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.067680 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.067846 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.068009 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.068173 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.068324 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.068512 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.068658 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.068828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.068978 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.069139 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.069301 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.069458 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.069608 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.069778 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.069915 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.070108 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.070224 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.070426 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.070544 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.070741 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.070866 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.071059 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.071197 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.071370 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.071512 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.071690 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.071824 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.072041 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.072172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.072362 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.072499 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.072677 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.072793 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.073019 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.073134 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.073361 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.073461 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.073674 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.073760 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.073998 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.074082 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.074319 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.074419 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.074632 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.074719 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.074942 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.075028 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.075251 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.075341 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.075557 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.075649 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.075867 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.075962 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.076171 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.076261 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.076513 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.076621 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.076833 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.076920 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.077141 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.077238 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.077448 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.077535 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.077756 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.077849 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.078064 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.078159 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.078368 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.078461 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.078676 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.078779 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.078986 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.079086 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.079304 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.079390 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.079615 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.079720 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.079924 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.080010 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.080279 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.080455 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.080622 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.080828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.080939 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.081149 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.081235 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.081463 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.081552 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.081774 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.081871 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.082092 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.082201 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.082396 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.082493 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.082705 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.082850 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.082988 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.083128 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.083312 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.083478 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.083629 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.083775 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.083923 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.084067 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.084224 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.084395 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.084556 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.084660 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.084868 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.085031 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.085171 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.085327 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.085468 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.085608 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.085750 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.085894 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.086041 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.086179 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.086332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.086478 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.086629 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.086790 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.086944 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.087074 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.087225 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.087314 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.087525 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.087621 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.087843 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.087979 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.088150 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.088297 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.088542 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.088686 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.088844 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.089011 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.089229 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.089356 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.089428 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.089607 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.089712 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.089915 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.090012 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.090223 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.090310 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.090543 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.090631 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.090861 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.090968 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.091163 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.091252 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.091491 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.091579 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.091811 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.091898 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.092111 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.092199 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.092439 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.092529 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.092752 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.092838 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.093057 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.093143 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.093355 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.093485 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.093659 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.093747 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.093956 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.094040 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.094258 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.094345 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.094560 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.094653 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.094861 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.094961 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.095162 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.095250 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.095461 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.095549 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.096300 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.096566 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.096731 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.096899 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.097010 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.097080 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.097232 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.097330 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.097537 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.097625 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.097838 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.097925 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.098139 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.098229 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.098438 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.098534 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.098776 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.098862 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.099076 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.099165 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.099412 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.099500 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.099741 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.099827 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.100055 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.100143 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.100841 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.100976 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.100976 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.101167 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.101256 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.101348 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.101435 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.101522 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.101601 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.101771 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.101873 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.102086 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.102173 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.102410 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.102497 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.102721 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.102810 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.103048 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.103143 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.103350 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.103447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.103670 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.103757 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.103972 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.104103 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.104287 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.104406 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.104594 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.104677 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.104907 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.105005 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.105243 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.105332 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.105570 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.105661 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.105883 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.105978 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.106193 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.106288 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.106496 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.106590 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.106804 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.106900 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.107108 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.107204 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.107413 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.107500 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.107718 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.107817 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.108022 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.108119 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.108334 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.108485 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.108661 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.108776 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.108973 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.109102 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.109277 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.110207 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.110207 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.110207 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.110416 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.110496 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.110583 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.110758 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.110847 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.111080 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.111184 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.111510 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.112156 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.112388 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.112482 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.112693 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.112796 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.113010 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.113099 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.113333 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.113421 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.113646 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.113797 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.113955 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.114042 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.114258 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.114345 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.114560 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.114654 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.114863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.114948 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.115171 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.115256 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.115472 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.115560 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.115777 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.115873 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.116078 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.116166 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.116408 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.116498 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.116718 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.116805 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.117017 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.117104 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.117315 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.117404 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.117614 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.117699 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.117924 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.118020 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.118228 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.118320 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.118544 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.118630 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.118858 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.118953 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.119160 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.119248 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.119469 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.119649 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.119777 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.119973 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.120079 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.120281 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.120399 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.120608 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.120696 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.120913 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.121004 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.121214 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.121303 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.121551 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.121639 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.121861 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.121950 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.122161 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.122249 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.122473 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.122575 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.122789 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.122883 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.123093 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.123180 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.123404 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.123505 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.123711 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.123838 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.124031 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.124119 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.124329 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.124451 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.124661 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.124749 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.124966 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.125053 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.125270 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.125368 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.125576 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.125664 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.125883 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.125976 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.126184 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.126272 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.126501 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.126590 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.126803 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.126894 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.127140 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.127238 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.127451 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.127547 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.127752 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.127884 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.128054 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.128145 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.128381 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.128471 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.128956 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.129053 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.129287 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.129383 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.129600 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.129686 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.129910 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.130007 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.130225 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.130314 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.130539 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.130627 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.130864 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.130962 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.131186 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.131274 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.131522 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.131619 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.131829 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.131926 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.132129 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.132215 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.132456 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.132546 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.132758 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.132856 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.133064 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.133162 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.133361 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.133455 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.133662 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.133750 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.133963 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.134060 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.134268 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.134394 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.134565 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.134652 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.134863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.134961 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.135159 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.135248 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.135460 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.135553 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.135768 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.135863 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.136071 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.136164 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.136393 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.136483 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.136697 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.136838 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.137016 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.137106 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.137318 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.137406 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.137617 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.137707 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.137916 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.138002 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.138211 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.138297 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.138545 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.138635 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.138846 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.138934 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.139176 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.139272 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.139499 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.139586 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.139833 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.139926 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.140136 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.140234 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.140461 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.140551 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.140780 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.140879 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.141079 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.141177 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.141378 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.141466 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.141678 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.141764 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.141984 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.142085 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.142287 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.142385 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.142588 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.142692 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.142922 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.143205 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.143295 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.143516 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.143612 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.143819 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.143915 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.144122 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.144220 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.144450 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.144543 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.144757 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.144865 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.145068 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.145158 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.145374 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.145462 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.145678 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.145775 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.145979 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.146067 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.146276 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.146369 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.146581 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.146670 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.146883 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.146977 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.147182 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.147269 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.147530 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.147884 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.148032 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.148119 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.148384 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.148489 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.148666 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.148755 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.148970 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.149055 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.149268 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.149363 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.149572 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.149662 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.149873 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.149968 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.150171 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.150266 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.150489 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.150586 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.150793 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.150879 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.151092 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.151193 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.151392 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.151480 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.151694 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.151781 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.151995 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.152091 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.152294 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.152402 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.152622 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.152714 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.152938 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.153034 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.153242 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.153330 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.153538 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.153636 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.153839 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.153927 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.154135 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.154223 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.154433 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.154562 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.154733 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.154823 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.155033 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.155119 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.155328 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.155414 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.155624 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.155714 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.155920 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.156009 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.156218 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.156306 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.156539 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.156632 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.156854 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.156940 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.157153 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.157253 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.157454 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.157541 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.157753 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.157840 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.158053 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.158190 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.158895 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.159081 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.159269 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.159458 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.159563 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.159724 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.159876 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.160028 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.160191 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.160359 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.160527 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.160674 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.160838 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.160979 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.161150 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.161284 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.161454 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.161590 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.161767 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.161889 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.162076 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.162199 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.162391 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.162511 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.162696 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.162820 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.163001 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.163121 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.163322 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.163412 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.163631 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.163727 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.163941 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.164029 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.164265 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.164373 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.164613 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.164723 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.164936 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.165026 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.165241 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.165331 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.165541 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.165635 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.165845 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.166011 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.166149 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.166237 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.166451 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.166537 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.166758 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.166855 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.167063 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.167162 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.167366 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.167460 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.167670 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.167772 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.167974 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.168064 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.168280 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.168422 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.168614 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.168716 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.168917 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.169004 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.169221 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.169311 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.169527 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.169616 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.169829 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.169915 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.170152 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.170265 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.170456 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.170554 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.170755 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.170848 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.171056 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.171147 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.171353 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.171453 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.171655 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.171742 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.171954 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.172087 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.172405 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.172500 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.172717 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.172817 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.173026 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.173198 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.173328 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.173425 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.173634 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.173728 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.173998 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.174707 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.174854 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.174945 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.175108 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.175246 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.175412 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.175668 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.175827 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.175970 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.176136 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.176280 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.176475 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.176622 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.176862 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.176951 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.177169 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.177259 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.177471 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.177561 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.177779 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.177870 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.178099 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.178188 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.178400 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.178489 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.178701 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.178814 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.179002 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.179094 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.179310 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.179398 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.179606 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.179699 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.179923 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.180019 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.180329 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.180439 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.180658 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.180745 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.180959 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.181096 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.181371 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.181486 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.181676 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.181770 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.181983 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.182079 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.182306 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.182400 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.182622 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.182709 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.182924 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.183020 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.183227 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.183328 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.183533 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.183627 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.183833 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.183920 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.184153 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.184326 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.184485 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.184582 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.184797 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.184928 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.185102 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.185201 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.185403 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.185490 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.185722 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.185818 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.186031 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.186124 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.186338 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.186432 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.186656 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.186744 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.187065 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.187156 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.187374 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.187461 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.187677 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.187764 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.187994 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.188083 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.188299 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.188452 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.188631 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.188729 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.188931 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.189019 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.189234 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.189320 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.189570 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.189721 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.189870 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.189987 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.190187 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.190277 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.190492 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.190609 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.190797 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.190887 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.191103 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.191192 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.191407 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.191506 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.191706 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.191803 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.192003 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.192094 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.192324 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.192446 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.192646 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.192744 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.192966 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.193056 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.193275 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.193365 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.193591 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.193687 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.193895 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.193989 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.194193 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.194289 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.194509 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.194596 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.194808 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.194897 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.195107 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.195208 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.195406 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.195496 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.195706 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.195806 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.196035 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.196124 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.196330 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.196435 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.196664 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.196766 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.196989 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.197079 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.197310 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.197442 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.197615 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.197712 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.197942 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.198033 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.198258 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.198344 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.198570 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.198670 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.198881 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.198971 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.199187 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.199281 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.199487 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.199624 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.199786 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.199876 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.200086 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.200172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.200401 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.200507 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.200703 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.200800 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.201004 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.201099 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.201306 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.201394 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.201604 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.201704 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.201904 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.201990 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.202200 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.202289 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.202515 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.202603 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.202815 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.202912 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.203131 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.203228 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.203432 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.203519 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.203730 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.203829 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.204030 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.204117 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.204325 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.204462 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.204686 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.204784 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.204987 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.205071 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.205330 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.205653 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.205748 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.205972 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.206062 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.206288 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.206376 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.206610 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.206697 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.206924 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.207014 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.207237 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.207325 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.207548 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.207649 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.207859 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.207948 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.208165 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.208253 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.208502 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.208607 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.208807 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.208894 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.209118 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.209214 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.209430 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.209634 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.209785 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.209961 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.210242 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.210331 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.210569 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.210667 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.210877 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.210964 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.211183 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.211269 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.211491 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.211590 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.211797 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.211895 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.212102 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.212190 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.212430 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.212533 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.212738 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.212827 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.213043 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.213131 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.213348 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.213439 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.213667 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.213756 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.213984 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.214081 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.214302 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.214390 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.214617 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.214705 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.214930 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.215027 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.215240 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.215373 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.215551 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.215649 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.215863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.215953 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.216179 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.216266 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.216524 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.216615 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.216836 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.216933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.217146 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.217235 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.217456 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.217555 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.217764 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.217861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.218070 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.218166 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.218375 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.218477 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.218682 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.218770 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.218989 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.219083 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.219294 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.219392 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.219598 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.219687 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.219905 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.220010 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.220214 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.220305 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.220557 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.220650 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.221445 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.221544 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.221763 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.221954 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.222074 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.222291 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.222386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.222691 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.222832 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.223116 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.223211 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.223451 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.223541 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.223777 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.223878 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.224104 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.224193 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.224448 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.224539 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.224764 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.224855 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.225077 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.225219 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.225383 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.225480 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.225685 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.225776 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.225986 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.226074 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.226292 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.226380 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.226596 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.226692 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.226896 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.226984 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.227210 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.227296 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.227512 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.227601 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.227813 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.227906 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.228123 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.228218 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.228448 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.228688 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.228974 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.229063 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.229316 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.229418 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.229628 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.229726 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.229951 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.230041 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.230265 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.230360 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.230572 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.230660 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.230873 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.230960 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.231189 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.231285 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.231489 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.231575 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.231789 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.231879 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.232095 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.232183 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.232424 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.232535 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.232727 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.232814 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.233030 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.233132 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.233335 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.233422 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.233636 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.233730 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.233936 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.234025 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.234234 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.234319 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.234530 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.234628 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.234849 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.234937 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.235146 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.235234 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.235446 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.235590 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.235742 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.235830 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.236040 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.236126 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.236333 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.237073 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.237245 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.237355 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.237609 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.237696 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.237922 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.238026 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.238227 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.238324 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.238535 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.238623 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.238841 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.238938 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.239152 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.239249 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.239457 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.239545 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.239760 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.239857 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.240061 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.240148 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.240374 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.240465 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.240698 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.240790 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.240998 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.241086 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.241341 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.241428 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.241653 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.241751 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.241959 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.242049 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.242272 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.242358 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.242583 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.242673 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.242888 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.242974 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.243227 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.243397 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.243540 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.243755 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.244065 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.244162 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.244423 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.244527 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.244759 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.244848 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.245091 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.245179 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.245403 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.245504 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.245713 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.245815 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.246022 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.246118 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.246342 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.246438 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.246657 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.246744 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.246961 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.247048 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.247267 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.247362 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.247569 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.247655 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.247876 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.248018 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.248178 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.248275 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.248510 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.248601 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.248819 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.248907 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.249120 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.249208 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.249423 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.249510 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.249725 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.249820 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.250029 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.250158 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.250333 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.250420 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.250635 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.250732 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.250937 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.251027 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.251247 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.251336 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.251574 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.251670 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.251886 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.251973 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.252838 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.253032 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.253159 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.253349 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.253472 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.253665 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.253783 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.253974 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.254094 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.254281 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.254405 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.254589 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.254721 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.254895 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.255050 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.255206 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.255363 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.255531 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.255668 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.255826 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.256080 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.256169 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.256420 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.256551 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.256742 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.256853 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.257063 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.257159 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.257371 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.257461 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.257695 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.257792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.258017 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.258105 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.258327 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.258414 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.258647 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.258739 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.258955 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.259044 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.259258 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.259344 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.259582 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.259671 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.259914 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.260011 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.260237 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.260323 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.260568 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.260662 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.260872 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.260958 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.261175 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.261271 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.261476 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.261569 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.261781 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.261868 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.262086 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.262181 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.262387 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.262481 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.262686 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.262773 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.262984 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.263080 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.263283 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.263369 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.263577 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.263671 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.263877 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.263974 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.264176 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.264263 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.264496 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.264585 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.264798 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.264888 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.265094 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.265180 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.265392 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.265480 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.265689 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.265787 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.265987 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.266081 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.266284 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.266374 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.266581 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.266671 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.266878 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.266972 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.267171 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.267258 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.267469 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.267563 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.268436 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.268572 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.268702 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.268798 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.269042 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.269132 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.269374 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.269463 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.269687 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.269787 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.269999 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.270086 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.270306 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.270393 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.270609 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.270708 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.270922 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.271010 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.271225 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.271312 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.271542 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.271640 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.271854 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.271942 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.272161 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.272255 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.272491 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.272848 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.273061 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.273148 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.273363 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.273450 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.273668 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.273759 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.273972 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.274060 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.274276 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.274367 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.274580 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.274669 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.274880 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.274977 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.275199 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.275288 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.275509 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.275605 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.275810 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.275908 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.276129 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.276228 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.276465 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.276558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.276781 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.276880 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.277089 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.277185 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.277396 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.277484 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.277711 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.277798 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.278015 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.278103 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.278319 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.278406 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.278623 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.278722 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.278926 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.279017 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.279230 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.279319 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.279534 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.279622 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.279835 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.279931 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.280138 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.280226 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.280471 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.280580 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.280783 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.280872 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.281105 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.281194 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.281412 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.281513 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.281718 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.281807 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.282038 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.282126 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.282357 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.282455 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.282672 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.282761 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.282992 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.283086 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.283367 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.283534 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.283690 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.283847 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.284002 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.284092 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.284379 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.284471 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.284625 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:35:41.284714 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:35:41.284933 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:35:41.439358 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO dbcounter [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Registered counter for database nova_api Aug 24 16:35:41.440688 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO dbcounter [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Registered counter for database nova_api Aug 24 16:35:41.461755 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_db.sqlalchemy.engines [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:35:41.463550 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG oslo_db.sqlalchemy.engines [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:35:41.468424 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writer thread running {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:35:41.470168 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG dbcounter [-] [112585] Writer thread running {{(pid=112585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:35:41.524891 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.context [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71e4e370-270f-4755-88e8-eb334db50fce(cell1) {{(pid=112584) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:35:41.527156 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.context [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71e4e370-270f-4755-88e8-eb334db50fce(cell1) {{(pid=112585) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:35:41.528783 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:35:41.529261 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:35:41.530843 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:35:41.531024 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG oslo_concurrency.lockutils [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:35:41.531499 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG oslo_concurrency.lockutils [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:35:41.531599 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:35:41.532007 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:35:41.533138 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG oslo_concurrency.lockutils [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:35:41.534550 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG oslo_concurrency.lockutils [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:35:41.534900 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:35:41.534994 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG oslo_concurrency.lockutils [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:35:41.536892 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO dbcounter [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Registered counter for database nova_cell0 Aug 24 16:35:41.537910 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG oslo_concurrency.lockutils [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:35:41.540972 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO dbcounter [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Registered counter for database nova_cell0 Aug 24 16:35:41.542285 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO dbcounter [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Registered counter for database nova_cell1 Aug 24 16:35:41.547281 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO dbcounter [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Registered counter for database nova_cell1 Aug 24 16:35:41.550376 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_db.sqlalchemy.engines [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:35:41.551300 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_db.sqlalchemy.engines [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:35:41.555287 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG oslo_db.sqlalchemy.engines [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:35:41.556933 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG oslo_db.sqlalchemy.engines [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:35:41.558046 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writer thread running {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:35:41.559519 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writer thread running {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:35:41.561967 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG dbcounter [-] [112585] Writer thread running {{(pid=112585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:35:41.701755 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG dbcounter [-] [112585] Writer thread running {{(pid=112585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:35:41.704175 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO dbcounter [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Registered counter for database nova_cell0 Aug 24 16:35:41.712441 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO dbcounter [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Registered counter for database nova_cell0 Aug 24 16:35:41.713554 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_db.sqlalchemy.engines [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:35:41.718069 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writer thread running {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:35:41.719364 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG oslo_db.sqlalchemy.engines [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:35:41.723642 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG dbcounter [-] [112585] Writer thread running {{(pid=112585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:35:42.130426 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: WARNING keystonemiddleware.auth_token [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:35:42.137718 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: WARNING keystonemiddleware.auth_token [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:35:42.147154 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: WARNING keystonemiddleware.auth_token [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:35:42.154618 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: WARNING keystonemiddleware.auth_token [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:35:42.479687 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: WARNING keystonemiddleware.auth_token [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:35:42.485662 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: WARNING keystonemiddleware.auth_token [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:35:42.490917 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e9a37a89c0 pid: 112584 (default app) Aug 24 16:35:42.493009 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:35:42.494198 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001770 Aug 24 16:35:42.494608 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Wed Aug 24 16:35:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:35:42.506624 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: WARNING keystonemiddleware.auth_token [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:35:42.512603 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: WARNING keystonemiddleware.auth_token [None req-20a0769f-55a1-4d64-9923-b8ea35c4b1c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:35:42.518387 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e9a37a89c0 pid: 112585 (default app) Aug 24 16:37:04.905788 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:04.906930 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 24 16:37:04.907424 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:04.923692 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG dbcounter [-] [112585] Writing DB stats nova_api:SELECT=3 {{(pid=112585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:04.924564 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG dbcounter [-] [112585] Writing DB stats nova_cell0:SELECT=3 {{(pid=112585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:04.925657 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG dbcounter [-] [112585] Writing DB stats nova_cell1:SELECT=3 {{(pid=112585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:04.926514 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG dbcounter [-] [112585] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:05.787880 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-753f6fa8-318b-428c-b714-58dccdaf1d68 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:05.822414 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-753f6fa8-318b-428c-b714-58dccdaf1d68 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.907758 Aug 24 16:37:05.823768 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Aug 24 16:37:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:37:08.185170 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:08.186127 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-27c5f97e-db87-4b79-a577-86b7e15240ed None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 16:37:08.188384 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:08.617414 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-550b4a04-f270-411c-9d08-0d8503d23f08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:08.638535 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:37:08.638535 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: warnings.warn(msg) Aug 24 16:37:08.717714 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-550b4a04-f270-411c-9d08-0d8503d23f08 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.524554 Aug 24 16:37:08.720703 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 16:37:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:37:08.733238 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writing DB stats nova_api:SELECT=3 {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:08.734377 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writing DB stats nova_cell0:SELECT=3 {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:08.735929 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writing DB stats nova_cell1:SELECT=3 {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:08.736601 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:08.949323 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-6d699efb-afea-4740-8872-0a6c78e6ab0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:08.954587 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:37:08.954587 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: warnings.warn(msg) Aug 24 16:37:09.075126 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-6d699efb-afea-4740-8872-0a6c78e6ab0e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348194 Aug 24 16:37:09.075905 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Aug 24 16:37:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:37:11.562024 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-550b4a04-f270-411c-9d08-0d8503d23f08 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:11.563029 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-550b4a04-f270-411c-9d08-0d8503d23f08 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 24 16:37:11.563446 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:12.276588 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-e5cbaeef-9924-4873-ba5e-ad4e1cfe2b09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:12.295953 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:37:12.295953 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: warnings.warn(msg) Aug 24 16:37:12.398294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-e5cbaeef-9924-4873-ba5e-ad4e1cfe2b09 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.828180 Aug 24 16:37:12.399117 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 16:37:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:37:12.411904 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-71b24758-2b62-4aed-9448-5a9504df056d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:12.414716 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:37:12.414716 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: warnings.warn(msg) Aug 24 16:37:12.510569 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-71b24758-2b62-4aed-9448-5a9504df056d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102733 Aug 24 16:37:12.520595 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Aug 24 16:37:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:37:14.889003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-e5cbaeef-9924-4873-ba5e-ad4e1cfe2b09 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:14.890545 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-e5cbaeef-9924-4873-ba5e-ad4e1cfe2b09 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002013 Aug 24 16:37:14.890949 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:37:15.299603 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-37df2730-f7d0-4cdd-b1bd-4f5b30c539e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "name": "ds1G", "id": "d2", "disk": 10, "os-flavor-access:is_public": true}} {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:15.379557 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-37df2730-f7d0-4cdd-b1bd-4f5b30c539e9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482265 Aug 24 16:37:15.380234 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 16:37:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:37:15.392774 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-c80d85a3-3fee-41a2-84e0-7b765a0c53f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:15.463455 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-c80d85a3-3fee-41a2-84e0-7b765a0c53f9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074222 Aug 24 16:37:15.463961 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Aug 24 16:37:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:37:17.844559 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-37df2730-f7d0-4cdd-b1bd-4f5b30c539e9 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:17.845582 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-37df2730-f7d0-4cdd-b1bd-4f5b30c539e9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 24 16:37:17.845985 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:18.353229 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-7ffc5e03-bbfc-44ef-b55f-0c3d672df54c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:18.427772 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-7ffc5e03-bbfc-44ef-b55f-0c3d672df54c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.575677 Aug 24 16:37:18.435962 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 16:37:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:37:18.441385 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-9d8dc62a-0f02-4fa0-a29f-4da345274c3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:18.529121 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-9d8dc62a-0f02-4fa0-a29f-4da345274c3c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091779 Aug 24 16:37:18.529958 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Aug 24 16:37:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:37:20.930978 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-7ffc5e03-bbfc-44ef-b55f-0c3d672df54c admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:20.932315 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-7ffc5e03-bbfc-44ef-b55f-0c3d672df54c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001905 Aug 24 16:37:20.933067 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:21.378297 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-8c0cb8a3-4a2d-4a24-8de5-41913bc81163 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:21.460517 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-8c0cb8a3-4a2d-4a24-8de5-41913bc81163 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519727 Aug 24 16:37:21.461620 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 16:37:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:37:21.473492 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-97a82469-7e56-417e-adaf-6ae78df6516a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:21.550701 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-97a82469-7e56-417e-adaf-6ae78df6516a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081143 Aug 24 16:37:21.551554 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Aug 24 16:37:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:37:24.007833 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-8c0cb8a3-4a2d-4a24-8de5-41913bc81163 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:24.008892 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-8c0cb8a3-4a2d-4a24-8de5-41913bc81163 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 24 16:37:24.009291 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:24.501091 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-0fb4a06b-b6b4-4423-85a1-e10609e90075 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:24.572749 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-0fb4a06b-b6b4-4423-85a1-e10609e90075 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.555413 Aug 24 16:37:24.573895 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Aug 24 16:37:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:37:27.225848 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-8c0cb8a3-4a2d-4a24-8de5-41913bc81163 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:27.226866 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-8c0cb8a3-4a2d-4a24-8de5-41913bc81163 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 16:37:27.227286 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:27.710158 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-5d9e1a14-3b79-410c-a904-b7b46c573065 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "id": "1", "ram": 512, "os-flavor-access:is_public": true}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:27.805430 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-5d9e1a14-3b79-410c-a904-b7b46c573065 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.569394 Aug 24 16:37:27.806358 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 16:37:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:37:27.818560 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-e35a67f5-ba9a-46e3-91de-d348507f74a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:27.893803 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-e35a67f5-ba9a-46e3-91de-d348507f74a1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078372 Aug 24 16:37:27.894385 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Aug 24 16:37:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:37:30.233003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-5d9e1a14-3b79-410c-a904-b7b46c573065 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:30.234013 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-5d9e1a14-3b79-410c-a904-b7b46c573065 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Aug 24 16:37:30.234412 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:30.641066 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-b7dbc3fe-4186-4144-961c-489b0d3596fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0}} {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:30.711119 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-b7dbc3fe-4186-4144-961c-489b0d3596fb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.470474 Aug 24 16:37:30.711737 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 16:37:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:37:30.723707 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-0e376bd5-edbe-4b1f-addc-92f6bf65c6ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:30.811479 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-0e376bd5-edbe-4b1f-addc-92f6bf65c6ac admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091436 Aug 24 16:37:30.812086 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Aug 24 16:37:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:37:33.254549 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-b7dbc3fe-4186-4144-961c-489b0d3596fb admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:33.255582 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-b7dbc3fe-4186-4144-961c-489b0d3596fb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 24 16:37:33.256253 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:33.701784 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-7ca87506-1427-48f7-8709-1a4ef126580c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "swap": 0, "name": "m1.medium"}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:33.777577 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-7ca87506-1427-48f7-8709-1a4ef126580c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.515028 Aug 24 16:37:33.778428 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 16:37:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:37:33.790357 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-60bfcad2-2591-41c5-b2b7-8c35f3ac0754 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:33.859766 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-60bfcad2-2591-41c5-b2b7-8c35f3ac0754 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073116 Aug 24 16:37:33.860916 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Aug 24 16:37:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:37:36.248329 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-7ca87506-1427-48f7-8709-1a4ef126580c admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:36.249456 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-7ca87506-1427-48f7-8709-1a4ef126580c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Aug 24 16:37:36.249985 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:36.697238 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-9f9de4c7-464f-4a53-963d-0a80bf0d1925 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:36.702834 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG dbcounter [-] [112585] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:36.779290 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-9f9de4c7-464f-4a53-963d-0a80bf0d1925 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.523227 Aug 24 16:37:36.780439 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 16:37:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:37:36.792410 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-54f1b90c-1636-4479-ba21-b7f215c279d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:36.894908 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-54f1b90c-1636-4479-ba21-b7f215c279d3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106824 Aug 24 16:37:36.896020 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Aug 24 16:37:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:37:39.319726 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-9f9de4c7-464f-4a53-963d-0a80bf0d1925 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:39.320930 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-9f9de4c7-464f-4a53-963d-0a80bf0d1925 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 24 16:37:39.321893 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:39.816963 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-ecf95790-f3fe-46bd-8b6d-683bc19b3ff4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:39.902574 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-ecf95790-f3fe-46bd-8b6d-683bc19b3ff4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.572874 Aug 24 16:37:39.903135 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 16:37:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:37:39.915753 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-96eeec18-2529-4640-b42d-3a70f96ba1df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:37:40.015308 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-96eeec18-2529-4640-b42d-3a70f96ba1df admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103471 Aug 24 16:37:40.016379 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Aug 24 16:37:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:37:59.565785 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-ecf95790-f3fe-46bd-8b6d-683bc19b3ff4 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:59.566803 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-ecf95790-f3fe-46bd-8b6d-683bc19b3ff4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 16:37:59.567210 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:37:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:59.956868 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-bc0abd04-9082-4245-9348-fc472c8f55c0 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:59.975372 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-bc0abd04-9082-4245-9348-fc472c8f55c0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401315 Aug 24 16:37:59.975910 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Aug 24 16:37:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:38:01.040403 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-ecf95790-f3fe-46bd-8b6d-683bc19b3ff4 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:01.041399 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-ecf95790-f3fe-46bd-8b6d-683bc19b3ff4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Aug 24 16:38:01.041786 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:38:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:38:01.567860 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-ad6b5717-753d-414d-bc22-2b35e9a8b300 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:01.574195 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.wsgi [None req-ad6b5717-753d-414d-bc22-2b35e9a8b300 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-ad6b5717-753d-414d-bc22-2b35e9a8b300 admin admin] Request method failure captured: Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Accept: application/json Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Accept-Encoding: gzip, deflate Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Connection: keep-alive Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Content-Length: 0 Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Host: 10.222.0.17 Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Openstack-Api-Version: compute 2.90 Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Openstack-System-Scope: None Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: User-Agent: python-novaclient Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Auth-Token: gAAAAABjBlPoynmEJCpKjxR3827Xr70c9fX37bwGrB4Dc2umP-T1TWvDAJPIDr74F73J1TFHdn15jf6WfxN9v-9r5eDqKTt4UXj42itQ0nRz1fHfQA3k905oXuUh89DSV7GbcHVsb8a-dxH9EvZVnEu4uEg1U0xt8a2mSIHhsCwzpYMpZLey3JY Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Domain-Id: None Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Domain-Name: None Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Identity-Status: Confirmed Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Is-Admin-Project: True Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Domain-Id: default Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Domain-Name: Default Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Name: admin Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Role: admin,reader,member Aug 24 16:38:01.577443 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Roles: admin,reader,member Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_86cc49d474614954959fd1fd2c69fbe7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Tenant: admin Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Tenant-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Tenant-Name: admin Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User: admin Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Domain-Id: default Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Domain-Name: Default Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Id: 1440567f43e04ab1bb7a5b1e330db669 Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Name: admin Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: method: > Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: exception: Flavor 42 could not be found. Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: action_args: {'id': '42'} Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:38:01.579130 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:01.580172 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:01.581644 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-ad6b5717-753d-414d-bc22-2b35e9a8b300 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:38:01.583000 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-ad6b5717-753d-414d-bc22-2b35e9a8b300 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.398893 Aug 24 16:38:01.583000 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 24 16:38:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:38:01.589560 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-6338cb2a-4531-4ab2-8c09-2a8568ccbef3 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:01.593737 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:38:01.619641 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-6338cb2a-4531-4ab2-8c09-2a8568ccbef3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034088 Aug 24 16:38:01.620212 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 16:38:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:38:01.630062 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-bc890eec-8a6c-4b2d-a167-99e10eca9848 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:01.654297 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-bc890eec-8a6c-4b2d-a167-99e10eca9848 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027744 Aug 24 16:38:01.654857 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 16:38:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:38:01.665259 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-7f52e5da-a3e7-44bd-bc71-8cc69a0ffc19 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:01.673977 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.wsgi [None req-7f52e5da-a3e7-44bd-bc71-8cc69a0ffc19 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-7f52e5da-a3e7-44bd-bc71-8cc69a0ffc19 admin admin] Request method failure captured: Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Accept: application/json Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Accept-Encoding: gzip, deflate Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Connection: keep-alive Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Content-Length: 0 Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Host: 10.222.0.17 Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Openstack-Api-Version: compute 2.90 Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Openstack-System-Scope: None Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: User-Agent: python-novaclient Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Auth-Token: gAAAAABjBlPoynmEJCpKjxR3827Xr70c9fX37bwGrB4Dc2umP-T1TWvDAJPIDr74F73J1TFHdn15jf6WfxN9v-9r5eDqKTt4UXj42itQ0nRz1fHfQA3k905oXuUh89DSV7GbcHVsb8a-dxH9EvZVnEu4uEg1U0xt8a2mSIHhsCwzpYMpZLey3JY Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Domain-Id: None Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Domain-Name: None Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Identity-Status: Confirmed Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Is-Admin-Project: True Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Domain-Id: default Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Domain-Name: Default Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Name: admin Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Role: admin,reader,member Aug 24 16:38:01.677447 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Roles: admin,reader,member Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_86cc49d474614954959fd1fd2c69fbe7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Tenant: admin Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Tenant-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Tenant-Name: admin Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User: admin Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Domain-Id: default Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Domain-Name: Default Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Id: 1440567f43e04ab1bb7a5b1e330db669 Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Name: admin Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: method: > Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: exception: Flavor 42 could not be found. Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: action_args: {'id': '42'} Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:38:01.691003 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:01.691956 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:01.693294 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-7f52e5da-a3e7-44bd-bc71-8cc69a0ffc19 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:38:01.694540 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-7f52e5da-a3e7-44bd-bc71-8cc69a0ffc19 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018114 Aug 24 16:38:01.694540 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 24 16:38:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:38:02.717324 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-bc890eec-8a6c-4b2d-a167-99e10eca9848 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:02.719414 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-bc890eec-8a6c-4b2d-a167-99e10eca9848 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Aug 24 16:38:02.719814 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:38:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:38:03.256359 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-d47c5404-8d77-4f29-b99f-ff0cb598f726 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:03.262347 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.wsgi [None req-d47c5404-8d77-4f29-b99f-ff0cb598f726 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-d47c5404-8d77-4f29-b99f-ff0cb598f726 admin admin] Request method failure captured: Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Accept: application/json Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Accept-Encoding: gzip, deflate Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Connection: keep-alive Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Content-Length: 0 Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Host: 10.222.0.17 Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Openstack-Api-Version: compute 2.90 Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Openstack-System-Scope: None Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: User-Agent: python-novaclient Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Auth-Token: gAAAAABjBlPqGN4KOO66ZwcyhTp2unRTpZi0E3GyVEFKG0u77WngH3fD5eTRKNG_4l8hT3YJo4mnCU89vgQppgDyYz3HVDaTfUl24-UnLIU6TA0VaYc3IfIYkRzo5GzMGo3G4mcBtgl79xqexO4bjGlzBrkrY6GyUh-C1pcvYMewTfCNs-PYWH8 Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Domain-Id: None Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Domain-Name: None Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Identity-Status: Confirmed Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Is-Admin-Project: True Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Domain-Id: default Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Domain-Name: Default Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Name: admin Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Role: admin,reader,member Aug 24 16:38:03.263933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Roles: admin,reader,member Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_86cc49d474614954959fd1fd2c69fbe7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Tenant: admin Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Tenant-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Tenant-Name: admin Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User: admin Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Domain-Id: default Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Domain-Name: Default Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Id: 1440567f43e04ab1bb7a5b1e330db669 Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Name: admin Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: method: > Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: exception: Flavor 84 could not be found. Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: action_args: {'id': '84'} Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:38:03.265468 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:03.266415 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:03.267558 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-d47c5404-8d77-4f29-b99f-ff0cb598f726 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:38:03.268614 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-d47c5404-8d77-4f29-b99f-ff0cb598f726 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.404958 Aug 24 16:38:03.268614 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 24 16:38:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:38:03.276233 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-ff0ffdf1-fc39-4568-8411-5cd280976c3a admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:03.291868 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-ff0ffdf1-fc39-4568-8411-5cd280976c3a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019935 Aug 24 16:38:03.292437 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 16:38:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:38:03.301914 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-f56b8b3f-ae63-46cd-91c9-d64a20d0b309 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:03.317406 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-f56b8b3f-ae63-46cd-91c9-d64a20d0b309 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018965 Aug 24 16:38:03.317933 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 16:38:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:38:03.327868 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-e6218209-100a-4ea5-8808-d5a58b6597ac admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:03.333280 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.wsgi [None req-e6218209-100a-4ea5-8808-d5a58b6597ac admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-e6218209-100a-4ea5-8808-d5a58b6597ac admin admin] Request method failure captured: Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Accept: application/json Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Accept-Encoding: gzip, deflate Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Connection: keep-alive Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Content-Length: 0 Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Host: 10.222.0.17 Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Openstack-Api-Version: compute 2.90 Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Openstack-System-Scope: None Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: User-Agent: python-novaclient Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Auth-Token: gAAAAABjBlPqGN4KOO66ZwcyhTp2unRTpZi0E3GyVEFKG0u77WngH3fD5eTRKNG_4l8hT3YJo4mnCU89vgQppgDyYz3HVDaTfUl24-UnLIU6TA0VaYc3IfIYkRzo5GzMGo3G4mcBtgl79xqexO4bjGlzBrkrY6GyUh-C1pcvYMewTfCNs-PYWH8 Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Domain-Id: None Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Domain-Name: None Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Identity-Status: Confirmed Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Is-Admin-Project: True Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Domain-Id: default Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Domain-Name: Default Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Name: admin Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Role: admin,reader,member Aug 24 16:38:03.334792 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Roles: admin,reader,member Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_86cc49d474614954959fd1fd2c69fbe7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Tenant: admin Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Tenant-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Tenant-Name: admin Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User: admin Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Domain-Id: default Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Domain-Name: Default Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Id: 1440567f43e04ab1bb7a5b1e330db669 Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Name: admin Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: method: > Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: exception: Flavor 84 could not be found. Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: action_args: {'id': '84'} Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:38:03.336377 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:03.339037 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:03.340334 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-e6218209-100a-4ea5-8808-d5a58b6597ac admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:38:03.341606 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-e6218209-100a-4ea5-8808-d5a58b6597ac admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011871 Aug 24 16:38:03.341606 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 24 16:38:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 16:38:04.302529 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-f56b8b3f-ae63-46cd-91c9-d64a20d0b309 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:04.303563 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-f56b8b3f-ae63-46cd-91c9-d64a20d0b309 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 24 16:38:04.303955 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:38:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:38:04.829245 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-94c67cd2-ae69-4b57-85e9-465f235ed015 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:04.834829 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.wsgi [None req-94c67cd2-ae69-4b57-85e9-465f235ed015 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-94c67cd2-ae69-4b57-85e9-465f235ed015 admin admin] Request method failure captured: Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Accept: application/json Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Accept-Encoding: gzip, deflate Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Connection: keep-alive Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Content-Length: 0 Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Host: 10.222.0.17 Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Openstack-Api-Version: compute 2.90 Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Openstack-System-Scope: None Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: User-Agent: python-novaclient Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Auth-Token: gAAAAABjBlPsDATqwHUEEaZBPvQGNp48awS2on6nr0dl9RHlJ2D7e_HXQrmap5sd8Do7ziGOufax1q6_0ZebLr4JzE--YBP121P64XVi5BfdaUD52De9u_02OrbLb0MS0wYfaeINpbbuxdSqLTdYycXBJ0k1alhobL4qcJfe26QjFNXem8sr_IQ Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Domain-Id: None Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Domain-Name: None Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Identity-Status: Confirmed Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Is-Admin-Project: True Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Domain-Id: default Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Domain-Name: Default Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Project-Name: admin Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Role: admin,reader,member Aug 24 16:38:04.836386 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Roles: admin,reader,member Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_86cc49d474614954959fd1fd2c69fbe7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Tenant: admin Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Tenant-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-Tenant-Name: admin Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User: admin Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Domain-Id: default Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Domain-Name: Default Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Id: 1440567f43e04ab1bb7a5b1e330db669 Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: X-User-Name: admin Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: method: > Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: exception: Flavor 451 could not be found. Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: action_args: {'id': '451'} Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:38:04.837863 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:04.838794 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: ERROR nova.api.openstack.wsgi Aug 24 16:38:04.840332 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-94c67cd2-ae69-4b57-85e9-465f235ed015 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:38:04.841519 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-94c67cd2-ae69-4b57-85e9-465f235ed015 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395653 Aug 24 16:38:04.841519 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 16:38:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:38:04.847323 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-ca10e318-8d6e-4f46-bf5c-c9507dec0e2d admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:04.862793 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-ca10e318-8d6e-4f46-bf5c-c9507dec0e2d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019018 Aug 24 16:38:04.863318 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 16:38:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:38:04.873504 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:04.888657 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018634 Aug 24 16:38:04.889208 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 16:38:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:38:04.898686 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-fac4e7e3-4ed5-4df6-b27d-2234da1d1a8a admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:04.904775 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.wsgi [None req-fac4e7e3-4ed5-4df6-b27d-2234da1d1a8a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-fac4e7e3-4ed5-4df6-b27d-2234da1d1a8a admin admin] Request method failure captured: Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Accept: application/json Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Accept-Encoding: gzip, deflate Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Connection: keep-alive Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Content-Length: 0 Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Host: 10.222.0.17 Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Openstack-Api-Version: compute 2.90 Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Openstack-System-Scope: None Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: User-Agent: python-novaclient Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Auth-Token: gAAAAABjBlPsDATqwHUEEaZBPvQGNp48awS2on6nr0dl9RHlJ2D7e_HXQrmap5sd8Do7ziGOufax1q6_0ZebLr4JzE--YBP121P64XVi5BfdaUD52De9u_02OrbLb0MS0wYfaeINpbbuxdSqLTdYycXBJ0k1alhobL4qcJfe26QjFNXem8sr_IQ Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Domain-Id: None Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Domain-Name: None Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Identity-Status: Confirmed Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Is-Admin-Project: True Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Domain-Id: default Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Domain-Name: Default Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Project-Name: admin Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Role: admin,reader,member Aug 24 16:38:04.906278 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Roles: admin,reader,member Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_86cc49d474614954959fd1fd2c69fbe7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/86cc49d474614954959fd1fd2c69fbe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Tenant: admin Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Tenant-Id: 86cc49d474614954959fd1fd2c69fbe7 Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-Tenant-Name: admin Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User: admin Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Domain-Id: default Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Domain-Name: Default Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Id: 1440567f43e04ab1bb7a5b1e330db669 Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: X-User-Name: admin Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: method: > Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: exception: Flavor 451 could not be found. Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: action_args: {'id': '451'} Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:38:04.907828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:04.908861 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: ERROR nova.api.openstack.wsgi Aug 24 16:38:04.910230 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-fac4e7e3-4ed5-4df6-b27d-2234da1d1a8a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:38:04.911428 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-fac4e7e3-4ed5-4df6-b27d-2234da1d1a8a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012463 Aug 24 16:38:04.911428 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 16:38:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:38:05.886664 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:05.887578 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 24 16:38:05.888133 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:38:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:38:06.422235 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-d3bec0a1-fc24-4282-b1a9-143bbf719451 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:38:06.497994 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-d3bec0a1-fc24-4282-b1a9-143bbf719451 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.469569 Aug 24 16:38:06.498546 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 24 16:38:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:38:07.475265 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:07.476270 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 24 16:38:07.476887 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:38:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:38:08.002321 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-709c1990-897a-43e8-bf42-be3b17afd816 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:38:08.091941 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-709c1990-897a-43e8-bf42-be3b17afd816 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.472874 Aug 24 16:38:08.092534 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 24 16:38:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:38:09.063194 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:09.064195 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 24 16:38:09.064627 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:38:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:38:09.594786 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-1d4e8f13-1794-4db1-a285-70f64fb481dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:38:09.669707 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-1d4e8f13-1794-4db1-a285-70f64fb481dc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.465450 Aug 24 16:38:09.670293 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 24 16:38:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:38:10.666885 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:10.667914 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 24 16:38:10.668311 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:38:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:38:11.194085 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-1c424b8c-2245-4f17-a04b-7a2d7dd1e853 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:38:11.251393 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-1c424b8c-2245-4f17-a04b-7a2d7dd1e853 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.444516 Aug 24 16:38:11.251959 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 24 16:38:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:38:12.214948 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:12.215947 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 24 16:38:12.216360 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:38:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:38:12.750575 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-6618d8ae-ce6b-44b2-a54d-05fdddb9cb80 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:38:12.771139 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-6618d8ae-ce6b-44b2-a54d-05fdddb9cb80 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.415751 Aug 24 16:38:12.771606 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Wed Aug 24 16:38:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:07.286924 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:07.287943 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-117526c2-af0e-4543-95d1-cce83690eccd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 24 16:39:07.288371 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 16:39:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:07.298757 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:07.679975 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-4346b7fa-ab9e-492d-b7eb-741d0937bfc3 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:07.700196 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-4346b7fa-ab9e-492d-b7eb-741d0937bfc3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405869 Aug 24 16:39:07.700769 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Aug 24 16:39:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:07.721608 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG dbcounter [-] [112585] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:07.726024 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-8e9522bb-fdd6-4aa8-89d0-b31ee3f655f4 admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:07.733673 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-8e9522bb-fdd6-4aa8-89d0-b31ee3f655f4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013311 Aug 24 16:39:07.734253 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1283 bytes} [Wed Aug 24 16:39:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:07.747394 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-f36d7485-9754-4a44-b660-85680a759685 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:07.755963 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-f36d7485-9754-4a44-b660-85680a759685 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012032 Aug 24 16:39:07.756526 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1286 bytes} [Wed Aug 24 16:39:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:39:07.769255 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-ee8483bf-3764-4720-9578-c273d67ef0bb admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:07.791084 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-ee8483bf-3764-4720-9578-c273d67ef0bb admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013181 Aug 24 16:39:07.791084 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1286 bytes} [Wed Aug 24 16:39:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:39:07.792730 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-45955a74-f288-47ed-b25e-83b30f8c1a13 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:07.801338 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-45955a74-f288-47ed-b25e-83b30f8c1a13 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012746 Aug 24 16:39:07.802025 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1283 bytes} [Wed Aug 24 16:39:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:14.618871 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-ee8483bf-3764-4720-9578-c273d67ef0bb admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:14.619891 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-ee8483bf-3764-4720-9578-c273d67ef0bb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 24 16:42:14.620293 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:42:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:42:14.761817 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writing DB stats nova_api:SELECT=6 {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:14.927213 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-d80e06fd-6542-4b8c-a84c-d49c9195bed8 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:14.929577 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:42:14.929577 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: warnings.warn(msg) Aug 24 16:42:14.930691 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-d80e06fd-6542-4b8c-a84c-d49c9195bed8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:14.931166 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-d80e06fd-6542-4b8c-a84c-d49c9195bed8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:14.931590 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-d80e06fd-6542-4b8c-a84c-d49c9195bed8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:14.932295 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-d80e06fd-6542-4b8c-a84c-d49c9195bed8 admin admin] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:14.932920 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-d80e06fd-6542-4b8c-a84c-d49c9195bed8 admin admin] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:14.933333 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-d80e06fd-6542-4b8c-a84c-d49c9195bed8 admin admin] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:14.968610 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-d80e06fd-6542-4b8c-a84c-d49c9195bed8 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208117 Aug 24 16:42:14.976400 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 16:42:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:42:15.810848 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-ee8483bf-3764-4720-9578-c273d67ef0bb admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:15.811886 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-ee8483bf-3764-4720-9578-c273d67ef0bb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 24 16:42:15.813029 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:42:16.006443 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-b7d50fa4-7b59-4a3c-9f83-3455d47c3a27 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:16.009196 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:42:16.009196 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: warnings.warn(msg) Aug 24 16:42:16.010334 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-b7d50fa4-7b59-4a3c-9f83-3455d47c3a27 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:16.010816 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-b7d50fa4-7b59-4a3c-9f83-3455d47c3a27 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:16.011249 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-b7d50fa4-7b59-4a3c-9f83-3455d47c3a27 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:16.012273 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-b7d50fa4-7b59-4a3c-9f83-3455d47c3a27 admin admin] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:16.012748 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-b7d50fa4-7b59-4a3c-9f83-3455d47c3a27 admin admin] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:16.013166 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-b7d50fa4-7b59-4a3c-9f83-3455d47c3a27 admin admin] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:16.036589 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-b7d50fa4-7b59-4a3c-9f83-3455d47c3a27 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084311 Aug 24 16:42:16.037179 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 16:42:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:42:27.295395 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-ee8483bf-3764-4720-9578-c273d67ef0bb admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:27.296449 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-ee8483bf-3764-4720-9578-c273d67ef0bb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 24 16:42:27.296843 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:42:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:42:27.439986 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writing DB stats nova_cell0:SELECT=4 {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:27.440736 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writing DB stats nova_cell1:SELECT=4 {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:27.441352 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG dbcounter [-] [112584] Writing DB stats nova_api:SELECT=8 {{(pid=112584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:27.489911 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-a4a5d4ef-2255-499a-ace7-d43f6572f289 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:27.495728 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:42:27.495728 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: warnings.warn(msg) Aug 24 16:42:27.495728 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-a4a5d4ef-2255-499a-ace7-d43f6572f289 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:27.495728 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-a4a5d4ef-2255-499a-ace7-d43f6572f289 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:27.495728 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-a4a5d4ef-2255-499a-ace7-d43f6572f289 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:27.495728 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-a4a5d4ef-2255-499a-ace7-d43f6572f289 admin admin] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:27.496354 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-a4a5d4ef-2255-499a-ace7-d43f6572f289 admin admin] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:27.496354 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-a4a5d4ef-2255-499a-ace7-d43f6572f289 admin admin] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:27.521350 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-a4a5d4ef-2255-499a-ace7-d43f6572f289 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085877 Aug 24 16:42:27.521828 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 16:42:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:28.351219 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: DEBUG nova.api.openstack.wsgi [None req-ee8483bf-3764-4720-9578-c273d67ef0bb admin admin] Calling method '>' {{(pid=112585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:28.352213 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: INFO nova.api.openstack.requestlog [None req-ee8483bf-3764-4720-9578-c273d67ef0bb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Aug 24 16:42:28.352655 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: [pid: 112585|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 16:42:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:42:28.553233 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG nova.api.openstack.wsgi [None req-79e90db0-407f-4867-ad3c-eef6011a32a2 admin admin] Calling method '>' {{(pid=112584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:28.555632 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:42:28.555632 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: warnings.warn(msg) Aug 24 16:42:28.556770 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-79e90db0-407f-4867-ad3c-eef6011a32a2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:28.557236 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-79e90db0-407f-4867-ad3c-eef6011a32a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:28.557658 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-79e90db0-407f-4867-ad3c-eef6011a32a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:28.558361 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-79e90db0-407f-4867-ad3c-eef6011a32a2 admin admin] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:28.558849 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-79e90db0-407f-4867-ad3c-eef6011a32a2 admin admin] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:28.559212 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: DEBUG oslo_concurrency.lockutils [None req-79e90db0-407f-4867-ad3c-eef6011a32a2 admin admin] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:28.581228 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: INFO nova.api.openstack.requestlog [None req-79e90db0-407f-4867-ad3c-eef6011a32a2 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082317 Aug 24 16:42:28.581775 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: [pid: 112584|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 16:42:28 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:43:25.688772 dv-cinder-731167-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 16:43:25.689471 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: Wed Aug 24 16:43:25 2022 - graceful shutdown triggered... Aug 24 16:43:25.689921 dv-cinder-731167-2-iscsi devstack@n-api.service[112585]: Gracefully killing worker 2 (pid: 112585)... Aug 24 16:43:25.690459 dv-cinder-731167-2-iscsi devstack@n-api.service[112584]: Gracefully killing worker 1 (pid: 112584)... Aug 24 16:43:26.690244 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: worker 1 buried after 1 seconds Aug 24 16:43:26.690795 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: worker 2 buried after 1 seconds Aug 24 16:43:26.690795 dv-cinder-731167-2-iscsi devstack@n-api.service[112583]: goodbye to uWSGI. Aug 24 16:43:26.691841 dv-cinder-731167-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 16:43:26.692432 dv-cinder-731167-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 16:43:26.695244 dv-cinder-731167-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 16:43:26.705349 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 16:43:26.707939 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 16:43:26 2022] *** Aug 24 16:43:26.708083 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 16:43:26.708218 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 16:43:26.708363 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: nodename: dv-cinder-731167-2-iscsi Aug 24 16:43:26.708505 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: machine: x86_64 Aug 24 16:43:26.708620 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: clock source: unix Aug 24 16:43:26.708730 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: pcre jit disabled Aug 24 16:43:26.708846 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: detected number of CPU cores: 4 Aug 24 16:43:26.708957 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: current working directory: / Aug 24 16:43:26.709130 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: detected binary path: /usr/bin/uwsgi-core Aug 24 16:43:26.709130 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: your processes number limit is 47680 Aug 24 16:43:26.709130 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: your memory page size is 4096 bytes Aug 24 16:43:26.709130 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: detected max file descriptor number: 2048 Aug 24 16:43:26.709130 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: lock engine: pthread robust mutexes Aug 24 16:43:26.709525 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: thunder lock: enabled Aug 24 16:43:26.709525 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 16:43:26.709525 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 16:43:26.750577 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: Python main interpreter initialized at 0x555ebfd069c0 Aug 24 16:43:26.750577 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: python threads support enabled Aug 24 16:43:26.750577 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: your server socket listen backlog is limited to 100 connections Aug 24 16:43:26.750577 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: your mercy for graceful operations on workers is 90 seconds Aug 24 16:43:26.751029 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 16:43:26.751029 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: *** Operational MODE: preforking *** Aug 24 16:43:26.751291 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: *** uWSGI is running in multiple interpreter mode *** Aug 24 16:43:26.751291 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: spawned uWSGI master process (pid: 127611) Aug 24 16:43:26.751496 dv-cinder-731167-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 16:43:26.752056 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: spawned uWSGI worker 1 (pid: 127626, cores: 1) Aug 24 16:43:26.752618 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: spawned uWSGI worker 2 (pid: 127627, cores: 1) Aug 24 16:43:26.752956 dv-cinder-731167-2-iscsi devstack@n-api.service[127611]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 16:43:27.436148 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:43:27.445801 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:43:28.589214 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:43:28.589214 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: from cryptography.utils import int_from_bytes Aug 24 16:43:28.589836 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:43:28.589836 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: from cryptography.utils import int_from_bytes Aug 24 16:43:28.618041 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:43:28.618041 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: from cryptography.utils import int_from_bytes Aug 24 16:43:28.618596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:43:28.618596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: from cryptography.utils import int_from_bytes Aug 24 16:43:31.059450 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:43:31.059968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:43:31.060207 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:43:31.060597 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:43:31.060862 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:43:31.061838 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.062832 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.063173 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.063505 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.064015 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.064365 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.064700 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.065028 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.065375 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.065646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.065970 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.066303 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-731167-2-iscsi {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.066635 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.067143 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.067651 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.067990 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.068305 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.068665 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.068983 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.069498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.070922 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.070922 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.070922 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.070922 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.071324 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.071532 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.071846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.072157 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.072513 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.072843 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.073252 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-731167-2-iscsi {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.073584 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.073919 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.074225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.074656 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.074980 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.075296 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.075623 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.075964 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.076270 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.076647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.077541 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.078569 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.078908 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.079224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.079548 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.079868 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.080201 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.080544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.080858 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.081119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.081435 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.081766 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.082092 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.082424 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.082683 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.082948 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.083269 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.083598 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.083915 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.084228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.084568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.084883 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.085197 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.085514 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.085828 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.086141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.086466 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.086788 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.087117 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.087430 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.087754 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.088168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.088456 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.088776 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.089123 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.089450 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.089764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.090090 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.090417 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.090730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.091045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.091359 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.091758 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.092097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.092380 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.092785 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.093385 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.094199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.094690 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.094690 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.094991 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.095301 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.095623 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.095936 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.096251 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.096732 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.097047 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.097360 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.097674 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.097990 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.098305 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.098616 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.098943 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.099270 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.099578 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.099889 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.100202 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.100504 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:43:31.101004 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.101154 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:43:31.101300 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.101300 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.101580 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:43:31.101724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.101860 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:43:31.102006 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.102152 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:43:31.102288 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.102442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.102580 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.102716 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.102869 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.103008 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.103166 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.103320 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.103466 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.103613 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.103761 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.103951 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.104107 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.104245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.104445 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.104585 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.104756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.104911 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.105067 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.105219 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.105357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.105504 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.105655 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.105790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.105941 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-731167-2-iscsi {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.106089 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.106225 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.106385 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.106530 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.106695 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.108647 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.109261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.109347 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.109421 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.109500 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.110897 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111005 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111080 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111224 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111224 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111470 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111547 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111626 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111697 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111779 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111857 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.111936 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.112013 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.112083 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.112159 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.112242 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.112313 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.112418 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.112502 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.112574 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.112664 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.112748 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.112819 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.112895 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.112965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.113040 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-731167-2-iscsi {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.113126 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.113204 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.113279 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.113350 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.113417 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.113495 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.113566 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.113641 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.113711 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.113798 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.113876 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.117062 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.117413 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.117490 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.117577 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.117658 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.117728 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.117796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.117863 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.117952 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.118030 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.118106 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.118181 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.118257 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.118333 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.118416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.118486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.118555 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.118630 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.118707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.118783 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.118866 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.118949 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.119026 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.119095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.119170 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.119170 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.119318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.119393 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.119474 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.119542 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.119617 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.119617 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.119845 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.119916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.119984 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.120060 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.120140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.120140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.120284 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.120370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.121402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.121563 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.121723 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.122875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.123048 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.123197 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.123343 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.123495 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.124245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.124432 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.124594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.124740 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.125069 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.125224 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.125398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.125552 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.125704 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.125854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.125997 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.126153 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.126541 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.126718 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.126864 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.127006 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.127006 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.127307 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.127458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.127458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.127735 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.127886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.128043 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.128195 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.128359 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.128518 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.129318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.129476 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.129638 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.129789 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.129941 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.130107 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.130251 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.130400 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.130554 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.130704 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.130853 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.131018 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.131169 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.131319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.131462 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.131612 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.131763 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.131939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.132581 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.132751 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.132915 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.133163 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.133319 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.133525 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.133680 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.133830 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.133974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.134122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.134122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.134705 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.134856 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.135006 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.135150 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.135292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.135442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.135585 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.135745 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.135896 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.136048 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.136192 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.136365 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.136670 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.136820 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.136820 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.137124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.137268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.137410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.137565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.137724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.137878 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.138019 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.138160 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.138302 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.138452 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.138596 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.138745 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.138896 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.139054 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.139283 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.140203 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.141024 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.141179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.141338 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.141481 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.141638 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.141789 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.141938 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.142089 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.142676 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.143057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.143321 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.143472 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.143616 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.143769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.143921 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.144084 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.144449 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.145230 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.145347 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.145445 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.145531 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.145609 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.145688 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.145796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.145796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.145796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.145796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.145796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.146148 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.146237 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.146335 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.146425 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.146516 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.146729 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.146835 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.146918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.147010 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.147094 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.147094 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.147243 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.147324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.147324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.147480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.147563 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.147643 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.147731 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.147813 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.147902 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.147997 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.148088 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.148170 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.148250 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.148330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.148464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.148557 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.148648 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:43:31.148730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.148819 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.148913 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.149075 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.149162 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.149243 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.149341 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.149433 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.149524 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.149615 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.149700 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.149788 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.149870 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.149966 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150057 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150148 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150315 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150396 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150484 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150578 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150661 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.150990 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.151080 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.151162 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.151249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.151338 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.151421 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.151501 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.151594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.151707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.151845 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.152037 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.152141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.152389 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.152510 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.152713 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.152826 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.153035 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.153147 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.153368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.153464 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.153695 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.153788 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.154011 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.154113 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.154350 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.154443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.154674 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.154767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.155035 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.155371 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.155817 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.155911 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.156005 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.156091 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.156183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.156276 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.156427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.156547 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.156642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.156874 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.157049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.157208 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.157361 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.157510 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.157650 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.157818 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.157960 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.158136 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.158294 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.158443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.158582 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.158748 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.158889 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.159077 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.159223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.159392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.159531 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.159732 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.159880 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.160033 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.160174 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.160369 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.160464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.160722 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.160835 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.161045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.161152 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.161317 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.161413 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.161632 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.161722 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.161942 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.162021 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.162252 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.162342 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.162721 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.162826 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.162924 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.162994 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.163157 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.163249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.163522 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.163625 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.163774 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.163855 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.164094 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.164189 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.164428 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.164574 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.164741 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.164823 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.165050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.165131 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.165365 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.165452 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.165882 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.166130 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.166441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.166757 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.166948 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.167077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.167276 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.167387 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.167622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.167719 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.167964 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.168055 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.168294 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.168535 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.168646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.168775 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.168986 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.169067 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.169310 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.169399 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.169710 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.169826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.169939 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.170030 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.170254 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.170348 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.171150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.171254 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.171472 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.171635 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.171788 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.171970 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.172112 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.172292 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.172497 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.172621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.173345 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.173441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.173441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.173628 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.173712 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.173899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.174030 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.174227 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.174346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.174549 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.174654 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.174859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.174964 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.175171 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.175277 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.175479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.175582 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.175785 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.175887 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.176091 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.176195 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.176426 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.176538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.176736 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.176830 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.177045 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.177154 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.177353 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.177454 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.177665 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.177766 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.177974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.178071 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.178296 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.178389 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.178604 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.178697 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.178909 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.179208 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.179302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.179512 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.179611 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.179863 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.180028 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.180177 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.180329 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.180530 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.180670 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.180856 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.181000 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.181181 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.181320 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.181508 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.181647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.181825 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.181974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.182144 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.182330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.182458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.182541 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.182941 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.183089 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.183237 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.183377 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.183523 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.183671 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.183812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.183979 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.184113 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.184265 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.184444 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.184535 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.184616 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.184756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.184881 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.184986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.185190 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.185288 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.185499 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.185589 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.185808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.185908 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.186217 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.186835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.187027 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.187263 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.187439 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.187614 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.187758 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.187938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.188091 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.188266 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.188415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.188632 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.188726 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.188953 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.189052 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.189269 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.189374 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.189584 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.189683 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.189898 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.190001 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.190213 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.190317 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.190535 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.190625 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.190848 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.190945 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.191168 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.191266 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.191479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.191576 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.191803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.191912 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.192114 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.192214 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.192462 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.192558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.192773 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.192863 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.193091 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.193229 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.193404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.193503 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.193714 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.193805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.194030 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.194130 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.194343 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.194441 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.194654 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.194743 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.194968 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.195059 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.195274 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.195371 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.195585 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.195683 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.196016 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.196114 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.196198 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.196278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.196506 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.196610 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.196826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.196917 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.197131 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.197220 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.197442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.197593 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.197750 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.197854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.198065 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.198158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.198374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.198468 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.198677 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.198768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.198983 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.199081 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.199294 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.199384 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.199602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.199692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.199911 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.200000 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.200225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.200324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.200563 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.200665 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.200867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.200964 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.201174 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.201267 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.201487 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.201584 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.201823 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.201919 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.202129 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.202218 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.202473 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.202581 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.202735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.202841 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.203155 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.203263 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.203386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.203478 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.203692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.203793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.204010 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.204101 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.204881 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.205003 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.205003 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.205169 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.205263 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.205354 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.205452 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.205536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.205645 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.205868 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.205968 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.206192 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.206283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.206503 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.206603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.206816 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.206909 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.207126 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.207213 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.207454 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.207561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.207741 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.207822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.208074 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.208201 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.208399 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.208524 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.208714 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.208812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.209025 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.209127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.209327 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.209503 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.209639 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.209742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.209956 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.210058 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.210321 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.210530 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.210634 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.210866 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.210968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.211184 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.211298 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.211504 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.211601 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.211826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.211928 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.212147 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.212251 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.212486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.212581 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.212808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.212912 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.213135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.213253 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.213445 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.213613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.213768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.213910 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.214049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.214159 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.214354 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.214463 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.214671 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.214788 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.214978 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.215096 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.215285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.215380 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.215592 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.215696 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.215903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.215998 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.216206 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.216300 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.216538 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.216644 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.216844 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.216946 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.217150 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.217254 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.217532 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.218087 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.218190 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.218285 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.218378 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.218474 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.218561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.218644 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.218728 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.218812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.219014 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.219119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.219319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.219422 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.219624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.219726 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.219931 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.220054 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.220289 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.220397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.220618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.220723 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.220946 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.221032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.221265 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.221359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.221577 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.221678 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.221893 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.221996 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.222203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.222303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.222518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.222619 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.222832 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.222999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.223150 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.223377 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.223558 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.223721 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.223866 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.224014 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.224154 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.224300 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.224427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.224533 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.224661 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.224787 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.224974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.225107 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.225285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.225426 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.225596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.225735 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.225902 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.226159 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.226252 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.226478 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.226569 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.226806 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.226896 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.227116 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.227206 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.227426 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.227540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.227733 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.227838 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.228044 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.228159 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.228372 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.228491 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.228682 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.228788 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.228994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.229110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.229298 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.229411 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.229613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.229718 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.229920 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.230032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.230223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.230386 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.230532 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.230753 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.230909 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.231059 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.231208 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.231365 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.231527 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.231670 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.231822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.231966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.232116 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.232268 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.232435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.232575 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.232732 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.232898 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.233529 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.234304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.234464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.234464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.234714 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.234791 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.234871 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.234944 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.235196 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.235362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.235501 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.235650 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.235803 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.235952 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.236095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.236260 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.236460 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.236601 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.236746 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.236887 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.237037 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.237193 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.237346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.237495 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.237636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.237798 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.237936 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.238088 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.238242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.238385 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.238528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.238674 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.238833 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.238983 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.238983 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.239249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.239389 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.239531 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.239687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.239835 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.239986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.240138 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.240286 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.240410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.240515 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.240610 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.240781 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.240901 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.241108 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.241213 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.241424 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.241516 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.241747 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.241838 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.242065 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.242243 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.242401 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.242543 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.242689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.242840 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.242986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.243141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.243292 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.243442 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.243585 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.243716 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.243859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.243955 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.244240 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.244362 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.244493 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.244590 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.244817 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.244998 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.245131 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.245274 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.245446 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.245541 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.245767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.245875 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.246091 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.246188 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.246412 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.246505 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.246715 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.246809 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.247023 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.247131 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.247334 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.247646 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.247965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.248178 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.248263 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.248543 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.249234 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.249470 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.249903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.249981 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.250063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.250278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.250382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.250606 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.250697 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.250955 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.251068 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.251264 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.251358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.251570 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.251662 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.251899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.251983 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.252213 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.252307 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.252548 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.252641 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.252862 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.252956 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.253170 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.253275 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.253486 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.253582 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.253792 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.253889 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.254102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.254226 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.254417 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.254531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.254724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.254827 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.255035 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.255138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.255348 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.255449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.255676 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.255778 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.255988 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.256090 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.256316 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.256430 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.256657 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.256767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.256970 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.257064 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.257278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.257379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.257586 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.257695 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.257934 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.258042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.258249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.258355 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.258655 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.258772 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.258877 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.258963 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.259204 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.259550 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.259763 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.259867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.260073 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.260178 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.260400 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.260503 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.260728 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.260826 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.261039 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.261234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.261356 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.261449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.261675 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.261783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.261990 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.262086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.262310 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.262413 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.262630 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.262769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.262953 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.263083 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.263396 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.263489 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.263722 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.263825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.264991 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.265125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.265125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.265305 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.265450 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.265538 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.265622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.265714 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.265800 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.265890 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.265977 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.266066 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.266152 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.266236 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.266320 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.266447 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.266633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.266765 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.266969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.267071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.267297 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.267402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.267628 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.267723 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.267970 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.268065 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.268295 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.268423 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.268639 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.268746 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.269065 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.269278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.269383 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.269646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.269752 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.269966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.270071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.270279 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.270373 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.270590 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.270684 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.270905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.271010 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.271218 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.271325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.271525 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.271631 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.271839 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.271947 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.272148 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.272257 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.272488 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.272586 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.272805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.272902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.273118 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.273222 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.273426 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.273530 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.273735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.273841 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.274060 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.274161 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.274367 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.274467 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.274692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.274788 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.275014 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.275144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.275339 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.275456 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.275657 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.275767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.275962 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.276182 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.276287 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.276544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.276659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.276862 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.276968 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.277194 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.277287 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.277513 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.277604 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.277830 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.277920 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.278154 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.278253 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.278474 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.278566 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.278782 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.278872 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.279093 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.279183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.279408 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.279511 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.279727 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.279861 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.280121 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.280230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.280483 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.280723 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.280838 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.281052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.281145 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.281385 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.281492 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.281694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.281777 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.282006 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.282312 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.282420 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.282619 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.282718 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.282926 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.283026 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.283231 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.283337 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.283543 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.283634 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.283850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.283942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.284160 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.284287 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.284504 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.284618 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.284832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.284937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.285144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.285251 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.285462 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.285570 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.285772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.285874 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.286077 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.286171 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.286382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.286475 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.286687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.286790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.287000 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.287094 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.287309 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.287403 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.287622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.287727 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.287930 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.288024 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.288263 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.288499 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.288594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.288696 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.288902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.289009 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.289211 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.289301 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.289524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.289624 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.289829 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.289919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.290135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.290234 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.290442 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.290557 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.290751 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.290853 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.291060 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.291159 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.291366 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.291455 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.291678 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.291776 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.291983 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.292219 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.292320 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.292590 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.292685 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.292907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.293006 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.293210 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.293314 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.293527 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.293626 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.293835 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.293926 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.294148 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.294268 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.294464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.294567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.294774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.294891 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.295087 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.295194 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.295402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.296109 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.296272 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.296457 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.296651 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.297044 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.297135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.297228 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.297428 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.297518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.297751 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.297851 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.298077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.298173 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.298452 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.298727 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.298838 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.298930 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.299062 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.299157 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.299368 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.299473 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.299675 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.299767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.299992 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.300090 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.300304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.300420 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.300645 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.300736 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.300960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.301071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.301267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.301359 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.301578 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.301668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.301892 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.301989 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.302204 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.302295 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.302513 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.302604 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.302826 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.302915 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.303138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.303236 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.303449 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.303538 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.303763 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.303864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.304075 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.304173 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.304407 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.304517 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.304728 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.304843 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.305046 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.305139 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.305378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.305567 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.305697 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.306035 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.306137 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.306220 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.306320 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.306531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.306669 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.306873 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.306987 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.307172 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.307318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.307492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.307596 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.307813 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.307903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.308125 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.308224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.308458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.308571 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.308764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.308855 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.309074 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.309193 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.309379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.309565 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.309703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.309842 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.310014 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.310167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.310319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.310480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.310640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.310805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.310952 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.311757 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.312116 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.312230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.312474 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.312580 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.312804 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.312924 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.313121 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.313226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.313449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.313542 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.313769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.313881 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.314079 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.314170 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.314397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.314501 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.314720 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.314819 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.315009 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.315100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.315326 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.315448 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.315637 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.315756 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.315945 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.316050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.316250 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.316335 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.316587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.316696 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.317088 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.317184 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.317270 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.317347 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.317484 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.317587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.317788 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.317878 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.318096 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.318187 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.318411 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.318512 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.318714 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.318804 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.319019 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.319118 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.319325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.319416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.319628 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.319725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.319930 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.320029 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.320233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.320323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.320563 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.320666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.320868 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.320974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.321169 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.321254 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.321472 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.321569 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.321774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.321879 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.322076 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.322178 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.322380 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.322478 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.322690 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.322795 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.322993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.323085 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.323315 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.323402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.323621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.323713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.323947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.324035 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.324260 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.324379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.324608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.324701 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.324933 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.325031 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.325246 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.325337 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.325563 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.325668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.325922 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.326018 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.326204 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.326286 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.326521 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.326761 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.326998 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.327102 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.327404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.327495 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.327726 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.327817 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.328046 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.328145 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.328386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.328567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.328692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.328792 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.329001 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.329094 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.329326 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.329432 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.329640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.329736 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.329952 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.330045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.330265 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.330364 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.330577 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.330667 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.330886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.330984 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.331198 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.331316 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.331504 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.331598 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.331812 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.331905 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.332122 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.332236 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.332456 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.332550 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.332771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.332880 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.333082 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.333179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.333390 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.333481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.333698 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.333800 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.334014 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.334114 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.334340 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.334431 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.334660 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.334764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.334971 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.335073 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.335286 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.335373 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.335680 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.335798 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.335917 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.336016 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.336227 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.336326 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.336562 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.336658 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.336872 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.336964 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.337187 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.337275 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.337517 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.337625 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.337831 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.337921 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.338077 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:43:31.338175 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.338546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.338861 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.339179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.339500 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.339811 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.340132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.340478 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.340794 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.341115 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.341426 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.341757 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.342092 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.342531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.342878 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.343186 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.343494 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.343801 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.344113 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.344458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.344773 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.345082 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.345389 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.345700 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.346008 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.346313 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.346619 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.346929 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.347241 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.347547 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.347851 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.348163 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.348493 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.348799 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.349104 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.349415 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.349721 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.350027 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.350332 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.350638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.350942 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.351273 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.351607 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.351926 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.352246 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.352583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.352908 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.353220 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.353541 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.353864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.354181 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.354494 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.354828 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.355141 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.355455 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.355767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.356080 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.356414 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.356728 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.357055 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.357385 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.357694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.358558 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.358880 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.359204 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.359524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.359837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.360168 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.360506 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.360822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.361134 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.361446 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.361755 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.362072 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.362383 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.362694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.363012 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.363328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.363654 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.363980 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.364292 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.364662 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.364987 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.365334 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.365647 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.365994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.366319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.366637 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.366953 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.367260 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:43:31.367506 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:43:31.400580 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO dbcounter [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Registered counter for database nova_api Aug 24 16:43:31.421457 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:43:31.428017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writer thread running {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:43:31.429747 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO dbcounter [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Registered counter for database nova_api Aug 24 16:43:31.450122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_db.sqlalchemy.engines [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:43:31.456696 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writer thread running {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:43:31.484379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.context [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71e4e370-270f-4755-88e8-eb334db50fce(cell1) {{(pid=127626) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:43:31.488469 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:31.488952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:31.490525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:31.491275 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:31.491724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:31.493733 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:31.495704 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO dbcounter [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Registered counter for database nova_cell0 Aug 24 16:43:31.500742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO dbcounter [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Registered counter for database nova_cell1 Aug 24 16:43:31.508131 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:43:31.510755 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:43:31.513321 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.context [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71e4e370-270f-4755-88e8-eb334db50fce(cell1) {{(pid=127627) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:43:31.516400 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writer thread running {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:43:31.517923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:31.518397 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:31.519943 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:31.520699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:31.521152 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:31.521605 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writer thread running {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:43:31.523131 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:31.525162 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO dbcounter [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Registered counter for database nova_cell0 Aug 24 16:43:31.529171 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO dbcounter [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Registered counter for database nova_cell1 Aug 24 16:43:31.536971 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_db.sqlalchemy.engines [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:43:31.539227 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_db.sqlalchemy.engines [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:43:31.544694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writer thread running {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:43:31.547024 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writer thread running {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:43:31.667664 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO dbcounter [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Registered counter for database nova_cell0 Aug 24 16:43:31.675245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:43:31.679923 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writer thread running {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:43:31.696157 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO dbcounter [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Registered counter for database nova_cell0 Aug 24 16:43:31.703730 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_db.sqlalchemy.engines [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:43:31.709792 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writer thread running {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:43:32.002978 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: WARNING keystonemiddleware.auth_token [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:43:32.010563 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: WARNING keystonemiddleware.auth_token [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:43:32.032779 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: WARNING keystonemiddleware.auth_token [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:43:32.040132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: WARNING keystonemiddleware.auth_token [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:43:32.362996 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: WARNING keystonemiddleware.auth_token [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:43:32.369058 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: WARNING keystonemiddleware.auth_token [None req-5c6fbb14-d60a-4a0f-b881-17e70a8a6582 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:43:32.374471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555ebfd069c0 pid: 127626 (default app) Aug 24 16:43:32.415057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: WARNING keystonemiddleware.auth_token [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:43:32.422120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: WARNING keystonemiddleware.auth_token [None req-8f458fb7-4c43-4c78-bb81-f7c353f68e06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:43:32.427465 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555ebfd069c0 pid: 127627 (default app) Aug 24 16:44:07.809901 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=3 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:07.810771 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=3 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:07.811495 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=3 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:07.812230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=3 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:08.742868 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1f1d8994-0a90-48d4-b031-1439b6f705fb tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] Action: 'create', calling method: .version_select at 0x7f06ad6dd8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-545270885", "metadata": {"Type": "work"}}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:09.239034 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:09.240913 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:09.242092 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:09.243104 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:10.282081 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7559abf9-ad08-4fe5-8716-5955ee8cd129 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Action: 'create', calling method: .version_select at 0x7f06ad6dc8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-510969589", "metadata": {"Type": "work"}}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7559abf9-ad08-4fe5-8716-5955ee8cd129 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Request method failure captured: Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 121 Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVZjQQKMsmxWAxcKT_Q8z0w9zD5CH51e43TXxLGehAMBh7cERYeXzqUj3INeOGy66nD1M5htUZHWZnT667-llrBKaADBTYQixWIDtIJ5QAkbj3f3C92D_rc3_UhfF9XuzlRSsW6OrbzafkLo2w27EgW5JSkX9_8ZPebuewGXLI-Rj4 Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:44:10.296429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6dd83e5ccf51423e876b0dbe1b661bc5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 18df998dc1cb47d5b5a860bbc21cf705 Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-510969589", "metadata": {"Type": "work"}}} Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: Aug 24 16:44:10.297832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-510969589', 'metadata': {'Type': 'work'}}}} Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise error Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:44:10.298756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 16:44:10.300076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 16:44:10.302583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 16:44:10.302583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.302583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7559abf9-ad08-4fe5-8716-5955ee8cd129 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:44:10.302583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7559abf9-ad08-4fe5-8716-5955ee8cd129 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.070288 Aug 24 16:44:10.302583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 24 16:44:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1075 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:44:10.317613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dd0af83f-6781-4f7b-951f-3c1288e0d604 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Action: 'create', calling method: .version_select at 0x7f06ad6dcf70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-241402630", "metadata": {"Type": "work"}}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dd0af83f-6781-4f7b-951f-3c1288e0d604 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Request method failure captured: Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 119 Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVZjQQKMsmxWAxcKT_Q8z0w9zD5CH51e43TXxLGehAMBh7cERYeXzqUj3INeOGy66nD1M5htUZHWZnT667-llrBKaADBTYQixWIDtIJ5QAkbj3f3C92D_rc3_UhfF9XuzlRSsW6OrbzafkLo2w27EgW5JSkX9_8ZPebuewGXLI-Rj4 Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:44:10.323303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6dd83e5ccf51423e876b0dbe1b661bc5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 18df998dc1cb47d5b5a860bbc21cf705 Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-241402630", "metadata": {"Type": "work"}}} Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: Aug 24 16:44:10.325108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-241402630', 'metadata': {'Type': 'work'}}}} Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise error Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi '0' Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:44:10.326049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 16:44:10.328076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 16:44:10.329306 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 16:44:10.329306 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.329306 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dd0af83f-6781-4f7b-951f-3c1288e0d604 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:44:10.329306 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-dd0af83f-6781-4f7b-951f-3c1288e0d604 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011973 Aug 24 16:44:10.329306 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 2/2] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 24 16:44:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:44:10.336488 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-25b03fd2-20db-45a9-a1f1-5e7abc30e087 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Action: 'create', calling method: .version_select at 0x7f06ad5984c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-679669498", "metadata": {"Type": "work"}}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-25b03fd2-20db-45a9-a1f1-5e7abc30e087 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Request method failure captured: Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 118 Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVZjQQKMsmxWAxcKT_Q8z0w9zD5CH51e43TXxLGehAMBh7cERYeXzqUj3INeOGy66nD1M5htUZHWZnT667-llrBKaADBTYQixWIDtIJ5QAkbj3f3C92D_rc3_UhfF9XuzlRSsW6OrbzafkLo2w27EgW5JSkX9_8ZPebuewGXLI-Rj4 Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:44:10.341456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6dd83e5ccf51423e876b0dbe1b661bc5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 18df998dc1cb47d5b5a860bbc21cf705 Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-679669498", "metadata": {"Type": "work"}}} Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: Aug 24 16:44:10.347176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-679669498', 'metadata': {'Type': 'work'}}}} Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise error Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi '' Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:44:10.348032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 16:44:10.349509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 16:44:10.351699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 16:44:10.351699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:10.351699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-25b03fd2-20db-45a9-a1f1-5e7abc30e087 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:44:10.351699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-25b03fd2-20db-45a9-a1f1-5e7abc30e087 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010762 Aug 24 16:44:10.351699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 3/3] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 24 16:44:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 16:44:10.357216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9571b8ca-3d01-47a1-ad65-6007f7926a8f tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Calling method '.version_select at 0x7f06ad598ee0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:11.172449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-9571b8ca-3d01-47a1-ad65-6007f7926a8f tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] HTTP exception thrown: Volume tempest-invalid-703789504 could not be found. Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9571b8ca-3d01-47a1-ad65-6007f7926a8f tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Request method failure captured: Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-703789504 HTTP/1.1 Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVZjQQKMsmxWAxcKT_Q8z0w9zD5CH51e43TXxLGehAMBh7cERYeXzqUj3INeOGy66nD1M5htUZHWZnT667-llrBKaADBTYQixWIDtIJ5QAkbj3f3C92D_rc3_UhfF9XuzlRSsW6OrbzafkLo2w27EgW5JSkX9_8ZPebuewGXLI-Rj4 Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:44:11.176624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6dd83e5ccf51423e876b0dbe1b661bc5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 18df998dc1cb47d5b5a860bbc21cf705 Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Volume tempest-invalid-703789504 could not be found. Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': 'tempest-invalid-703789504'} Aug 24 16:44:11.178128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-703789504 could not be found. (HTTP 404) (Request-ID: req-764efe59-8ceb-4581-bf8d-abc0ae196cbc) Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:11.179042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:44:11.181629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-703789504 could not be found. Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:44:11.183986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-703789504 could not be found. Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-703789504 could not be found. Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9571b8ca-3d01-47a1-ad65-6007f7926a8f tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Returning 404 to user: Volume tempest-invalid-703789504 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9571b8ca-3d01-47a1-ad65-6007f7926a8f tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-703789504" status: 404 len: 98 microversion: 2.1 time: 0.827266 Aug 24 16:44:11.185340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 4/4] 10.222.0.17 () {58 vars in 1215 bytes} [Wed Aug 24 16:44:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-703789504 => generated 98 bytes in 828 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 16:44:11.192061 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6c7447d0-c2f0-4e46-83e7-22fefc0511ac tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004653 Aug 24 16:44:11.193038 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 5/5] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Aug 24 16:44:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 16:44:11.206347 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ac463c8a-90a5-4bc1-9323-2dfc60847eb8 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005934 Aug 24 16:44:11.208579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 6/6] 10.222.0.17 () {58 vars in 1137 bytes} [Wed Aug 24 16:44:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 16:44:11.220827 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c24b49da-6170-4c72-bc07-a928af7815d6 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Calling method '.version_select at 0x7f06ad4cf820>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:11.246509 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1f1d8994-0a90-48d4-b031-1439b6f705fb tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.454261 Aug 24 16:44:11.247231 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 1/7] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 24 16:44:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3457 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 16:44:11.268942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9d61891c-1f10-47e7-9a11-20c1ef0a8b20 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] Calling method '.version_select at 0x7f06ad534700>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:11.305112 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-c24b49da-6170-4c72-bc07-a928af7815d6 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] HTTP exception thrown: Volume 650db4a8-87cc-4719-b3ad-ebce647b3cae could not be found. Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c24b49da-6170-4c72-bc07-a928af7815d6 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Request method failure captured: Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/os-volumes/650db4a8-87cc-4719-b3ad-ebce647b3cae HTTP/1.1 Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVZjQQKMsmxWAxcKT_Q8z0w9zD5CH51e43TXxLGehAMBh7cERYeXzqUj3INeOGy66nD1M5htUZHWZnT667-llrBKaADBTYQixWIDtIJ5QAkbj3f3C92D_rc3_UhfF9XuzlRSsW6OrbzafkLo2w27EgW5JSkX9_8ZPebuewGXLI-Rj4 Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:44:11.307999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6dd83e5ccf51423e876b0dbe1b661bc5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 18df998dc1cb47d5b5a860bbc21cf705 Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Volume 650db4a8-87cc-4719-b3ad-ebce647b3cae could not be found. Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '650db4a8-87cc-4719-b3ad-ebce647b3cae'} Aug 24 16:44:11.309561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 650db4a8-87cc-4719-b3ad-ebce647b3cae could not be found. (HTTP 404) (Request-ID: req-4449ac45-fe73-4864-8143-ad8b4128df5d) Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:11.310479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:44:11.311631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 650db4a8-87cc-4719-b3ad-ebce647b3cae could not be found. Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 16:44:11.312994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:44:11.314142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 650db4a8-87cc-4719-b3ad-ebce647b3cae could not be found. Aug 24 16:44:11.314142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.314142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:11.314142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.314142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.314142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:11.314142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:11.314142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:44:11.314142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:44:11.314142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 650db4a8-87cc-4719-b3ad-ebce647b3cae could not be found. Aug 24 16:44:11.314142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.316432 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c24b49da-6170-4c72-bc07-a928af7815d6 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Returning 404 to user: Volume 650db4a8-87cc-4719-b3ad-ebce647b3cae could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:44:11.316773 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c24b49da-6170-4c72-bc07-a928af7815d6 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/650db4a8-87cc-4719-b3ad-ebce647b3cae" status: 404 len: 109 microversion: 2.1 time: 0.104176 Aug 24 16:44:11.321970 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 7/8] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 16:44:11 2022] DELETE /compute/v2.1/os-volumes/650db4a8-87cc-4719-b3ad-ebce647b3cae => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:44:11.331927 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c0e7ed71-631a-44ba-a0d0-b29aff8fe865 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Calling method '.version_select at 0x7f06ad4cf790>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:11.369305 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9d61891c-1f10-47e7-9a11-20c1ef0a8b20 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90" status: 200 len: 352 microversion: 2.1 time: 0.111754 Aug 24 16:44:11.370654 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 2/9] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:44:11 2022] GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:11.390369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-c0e7ed71-631a-44ba-a0d0-b29aff8fe865 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] HTTP exception thrown: Volume 75c0885b-5a13-4665-8d02-c444434f2ba6 could not be found. Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c0e7ed71-631a-44ba-a0d0-b29aff8fe865 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Request method failure captured: Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/os-volumes/75c0885b-5a13-4665-8d02-c444434f2ba6 HTTP/1.1 Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVZjQQKMsmxWAxcKT_Q8z0w9zD5CH51e43TXxLGehAMBh7cERYeXzqUj3INeOGy66nD1M5htUZHWZnT667-llrBKaADBTYQixWIDtIJ5QAkbj3f3C92D_rc3_UhfF9XuzlRSsW6OrbzafkLo2w27EgW5JSkX9_8ZPebuewGXLI-Rj4 Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:44:11.393138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6dd83e5ccf51423e876b0dbe1b661bc5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd83e5ccf51423e876b0dbe1b661bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 6dd83e5ccf51423e876b0dbe1b661bc5 Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesNegativeTest-1418279403 Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 18df998dc1cb47d5b5a860bbc21cf705 Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesNegativeTest-1418279403-project Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Volume 75c0885b-5a13-4665-8d02-c444434f2ba6 could not be found. Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '75c0885b-5a13-4665-8d02-c444434f2ba6'} Aug 24 16:44:11.394464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75c0885b-5a13-4665-8d02-c444434f2ba6 could not be found. (HTTP 404) (Request-ID: req-466d4807-32e8-4a7b-a498-2471f98fe702) Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:11.395233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:44:11.664521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75c0885b-5a13-4665-8d02-c444434f2ba6 could not be found. Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 16:44:11.666681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75c0885b-5a13-4665-8d02-c444434f2ba6 could not be found. Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75c0885b-5a13-4665-8d02-c444434f2ba6 could not be found. Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c0e7ed71-631a-44ba-a0d0-b29aff8fe865 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] Returning 404 to user: Volume 75c0885b-5a13-4665-8d02-c444434f2ba6 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c0e7ed71-631a-44ba-a0d0-b29aff8fe865 tempest-VolumesNegativeTest-1418279403 tempest-VolumesNegativeTest-1418279403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/75c0885b-5a13-4665-8d02-c444434f2ba6" status: 404 len: 109 microversion: 2.1 time: 0.072771 Aug 24 16:44:11.669285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 8/10] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:44:11 2022] GET /compute/v2.1/os-volumes/75c0885b-5a13-4665-8d02-c444434f2ba6 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:44:12.385255 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8533edd4-4d88-4f45-94da-4f8c6052f704 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] Calling method '.version_select at 0x7f06ad534dc0>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:12.504623 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8533edd4-4d88-4f45-94da-4f8c6052f704 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90" status: 200 len: 352 microversion: 2.1 time: 0.125364 Aug 24 16:44:12.505520 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 3/11] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:44:12 2022] GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:13.350787 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0d9fcdd4-f730-4c9b-a2a4-8bf9f279c7ff tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] Calling method '.version_select at 0x7f06ad51dc10>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:13.406143 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0d9fcdd4-f730-4c9b-a2a4-8bf9f279c7ff tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2c4e7c3b-15bd-42e3-b551-0ca6eeae3e23" status: 200 len: 350 microversion: 2.1 time: 0.059966 Aug 24 16:44:13.414958 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 9/12] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:44:13 2022] GET /compute/v2.1/os-volumes/2c4e7c3b-15bd-42e3-b551-0ca6eeae3e23 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:13.520634 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-673febe6-bbf3-4e58-8e02-c933613ddcd1 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] Calling method '.version_select at 0x7f06ad5504c0>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:13.737839 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-673febe6-bbf3-4e58-8e02-c933613ddcd1 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90" status: 200 len: 353 microversion: 2.1 time: 0.222572 Aug 24 16:44:13.738875 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 4/13] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:44:13 2022] GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 => generated 353 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:13.756019 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-36bcee13-2ada-4add-9118-ffa4a7184932 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] Calling method '.version_select at 0x7f06ad4cf1f0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:13.927188 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-36bcee13-2ada-4add-9118-ffa4a7184932 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90" status: 200 len: 353 microversion: 2.1 time: 0.175172 Aug 24 16:44:13.927764 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 10/14] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:44:13 2022] GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 => generated 353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:13.948438 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a9ca369f-8e0e-4d66-a733-3d4e22b6d025 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] Calling method '.version_select at 0x7f06ad534af0>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:14.619560 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a9ca369f-8e0e-4d66-a733-3d4e22b6d025 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90" status: 202 len: 0 microversion: 2.1 time: 0.675905 Aug 24 16:44:14.620846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 5/15] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 16:44:13 2022] DELETE /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:44:14.629447 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-818e0ba4-1518-4e1f-bc2c-77636e148a4b tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] Calling method '.version_select at 0x7f06ad4cfee0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:14.786850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-818e0ba4-1518-4e1f-bc2c-77636e148a4b tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90" status: 200 len: 352 microversion: 2.1 time: 0.146037 Aug 24 16:44:14.786850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 11/16] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:44:14 2022] GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:15.798521 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a105e6b9-caf5-4d79-b04f-9fcff83bdb26 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] Calling method '.version_select at 0x7f06ad5344c0>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:15.914765 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-a105e6b9-caf5-4d79-b04f-9fcff83bdb26 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] HTTP exception thrown: Volume c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 could not be found. Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a105e6b9-caf5-4d79-b04f-9fcff83bdb26 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] Request method failure captured: Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 HTTP/1.1 Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVX6App2_8_EQYp_nCKhO7Qv2bJk8usETHR1WFY_1F2WRvX6lsbbMyrEU87Wc-EGsqF5Vtqks9QUBDfgYAy6DyGGzPjgAv8o68tK27UMc1zaNxetWnkJE9YUumfi7ZXzXLVNCdTNNVRCuSvc_cB2l9op2mF90jMlFpo3wYJ513Qqd8 Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: f9652b4a38de4d4087e33ff15f193205 Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-VolumesGetTestJSON-536215906 Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:44:15.921636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f9652b4a38de4d4087e33ff15f193205"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f9652b4a38de4d4087e33ff15f193205"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f9652b4a38de4d4087e33ff15f193205", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f9652b4a38de4d4087e33ff15f193205"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-VolumesGetTestJSON-536215906 Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: f9652b4a38de4d4087e33ff15f193205 Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-VolumesGetTestJSON-536215906 Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-VolumesGetTestJSON-536215906-project Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: fc7edc3d8ae84e0585965afe4486bb27 Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-VolumesGetTestJSON-536215906-project Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Volume c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 could not be found. Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': 'c5450c5a-e7fb-4893-a01c-a1aefe4d1d90'} Aug 24 16:44:15.922724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 could not be found. (HTTP 404) (Request-ID: req-9ca5d8bd-dba5-4ddc-99ea-c6474c4b6b22) Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:15.923389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:44:15.924420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 could not be found. Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 16:44:15.925480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 could not be found. Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 could not be found. Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a105e6b9-caf5-4d79-b04f-9fcff83bdb26 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] Returning 404 to user: Volume c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:44:15.926314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a105e6b9-caf5-4d79-b04f-9fcff83bdb26 tempest-VolumesGetTestJSON-536215906 tempest-VolumesGetTestJSON-536215906-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90" status: 404 len: 109 microversion: 2.1 time: 0.132455 Aug 24 16:44:15.928543 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 6/17] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:44:15 2022] GET /compute/v2.1/os-volumes/c5450c5a-e7fb-4893-a01c-a1aefe4d1d90 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:44:16.970962 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b5f1fe81-a816-45c7-93f2-69d35e8b7320 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] Calling method '.version_select at 0x7f06ad4e0550>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:17.068527 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b5f1fe81-a816-45c7-93f2-69d35e8b7320 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/48535485-e40a-4c25-b4ae-ca9c6e96aabf" status: 200 len: 351 microversion: 2.1 time: 0.100835 Aug 24 16:44:17.075081 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 12/18] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:44:16 2022] GET /compute/v2.1/os-volumes/48535485-e40a-4c25-b4ae-ca9c6e96aabf => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:19.300395 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0b713a44-71f8-47be-8b0e-6e2b94499c85 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] Calling method '.version_select at 0x7f06ad550550>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:19.399158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0b713a44-71f8-47be-8b0e-6e2b94499c85 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/edf66722-5a0d-4cc6-ad4f-959d724d45d2" status: 200 len: 350 microversion: 2.1 time: 0.104171 Aug 24 16:44:19.400229 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 7/19] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:44:19 2022] GET /compute/v2.1/os-volumes/edf66722-5a0d-4cc6-ad4f-959d724d45d2 => generated 350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:19.413841 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-321e1d2b-e861-4639-9d51-f4949ec70297 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] Calling method '.version_select at 0x7f06ad4cf700>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:19.627298 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-321e1d2b-e861-4639-9d51-f4949ec70297 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.217488 Aug 24 16:44:19.628173 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 13/20] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Aug 24 16:44:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:19.649473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3d2d23e5-9f87-43d1-a903-c68c7f9da1a2 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] Calling method '.version_select at 0x7f06ad4b8550>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:19.803607 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3d2d23e5-9f87-43d1-a903-c68c7f9da1a2 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.159424 Aug 24 16:44:19.818284 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 8/21] 10.222.0.17 () {58 vars in 1149 bytes} [Wed Aug 24 16:44:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:19.828596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-72a050b1-9cc5-454f-9ef0-73373052d8e3 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] Calling method '.version_select at 0x7f06ad598040>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:20.005423 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-72a050b1-9cc5-454f-9ef0-73373052d8e3 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.190009 Aug 24 16:44:20.017891 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 14/22] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Aug 24 16:44:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:20.029439 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1de25d2b-b0c1-4aee-a420-c5264563017e tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] Calling method '.version_select at 0x7f06ad550e50>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:20.165849 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1de25d2b-b0c1-4aee-a420-c5264563017e tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.144461 Aug 24 16:44:20.166907 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 9/23] 10.222.0.17 () {58 vars in 1167 bytes} [Wed Aug 24 16:44:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:20.180251 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-73251f54-5bbc-4e42-8f13-2dfeb2824bf4 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] Calling method '.version_select at 0x7f06ad4cc160>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:20.325233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-73251f54-5bbc-4e42-8f13-2dfeb2824bf4 tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.149091 Aug 24 16:44:20.326098 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 15/24] 10.222.0.17 () {58 vars in 1170 bytes} [Wed Aug 24 16:44:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:20.340256 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-eb6562d7-228f-48bb-aaeb-6ba0059362fd tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] Calling method '.version_select at 0x7f06ad4c1040>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:20.516801 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-eb6562d7-228f-48bb-aaeb-6ba0059362fd tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.180833 Aug 24 16:44:20.517654 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 10/25] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Aug 24 16:44:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:20.534711 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-73b7de2f-25e9-414d-a340-9151fab9b24e tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] Calling method '.version_select at 0x7f06ad5988b0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:20.683498 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-73b7de2f-25e9-414d-a340-9151fab9b24e tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.154842 Aug 24 16:44:20.685338 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 16/26] 10.222.0.17 () {58 vars in 1188 bytes} [Wed Aug 24 16:44:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:20.709494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c1be714f-e69b-469a-b346-faed91454d4d tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] Calling method '.version_select at 0x7f06ad4c7280>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:20.896607 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c1be714f-e69b-469a-b346-faed91454d4d tempest-VolumesTestJSON-1507445963 tempest-VolumesTestJSON-1507445963-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.201978 Aug 24 16:44:20.908587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 11/27] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Aug 24 16:44:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:22.593821 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-664015940", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "networks": [{"uuid": "c87426b9-0121-444a-b1ac-0b19fffe7905"}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:22.794020 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] validate_networks() for [('c87426b9-0121-444a-b1ac-0b19fffe7905', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:44:25.609483 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:44:25.610558 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:44:25.611304 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:44:25.613785 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:44:25.613785 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:44:25.633187 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:25.633951 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:25.635616 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:25.636569 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:25.637773 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:25.638907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:25.716167 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Getting quotas for project d09164dc6ad44a87b7fae777d9f8435a. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:44:25.718896 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-829685c2-f9e7-4e0a-a540-52b6d55bf241 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: .version_select at 0x7f06ad4b8040>, body: {"keypair": {"name": "tempest-keypair-380955673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1dLrB0Q/h532MHHGNVGCcQpyfs/DLTPQq+7COo2CpLyjbXdL8W7zlqlL3xjThhvXvMqe1t3fjeoNADtnFqd43ac/glNzBqxHGg2qSRxi/9s00ofyg69Z6revB5KWLRJA=="}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:25.738101 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Getting quotas for user 491e2b9a44bd47b190b1a0b1250bf1f3 and project d09164dc6ad44a87b7fae777d9f8435a. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:44:25.792642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:44:25.798408 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:44:25.911961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-829685c2-f9e7-4e0a-a540-52b6d55bf241 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'key_pairs'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:44:25.940378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-829685c2-f9e7-4e0a-a540-52b6d55bf241 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for user 1d9f7755863d45bfb04a1498bd62e367 and project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'key_pairs'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:44:26.100703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-267eb00f-7281-48d4-b849-334f808213d9 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.838073 Aug 24 16:44:26.101433 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 17/28] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:44:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:44:26.237751 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dd80b5a7-1612-4e9e-af18-5a8994e0c781 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:26.237751 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-dd80b5a7-1612-4e9e-af18-5a8994e0c781 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:26.358138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-dd80b5a7-1612-4e9e-af18-5a8994e0c781 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:26.379584 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-829685c2-f9e7-4e0a-a540-52b6d55bf241 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.376822 Aug 24 16:44:26.380803 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 12/29] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 16:44:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:44:26.397096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-dd80b5a7-1612-4e9e-af18-5a8994e0c781 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1214 microversion: 2.1 time: 0.285684 Aug 24 16:44:26.398840 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 18/30] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:26 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1214 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:27.420929 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-627ab838-7783-48aa-86ed-e8ecd3a84fde tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:27.421733 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-627ab838-7783-48aa-86ed-e8ecd3a84fde tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:27.654962 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-627ab838-7783-48aa-86ed-e8ecd3a84fde tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:27.683729 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-627ab838-7783-48aa-86ed-e8ecd3a84fde tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1214 microversion: 2.1 time: 0.268523 Aug 24 16:44:27.700474 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 13/31] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:27 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1214 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:28.709157 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b329c3ac-8b25-48a9-8961-61b98bcfac06 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:28.709795 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b329c3ac-8b25-48a9-8961-61b98bcfac06 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:29.056037 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b329c3ac-8b25-48a9-8961-61b98bcfac06 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:29.071288 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b329c3ac-8b25-48a9-8961-61b98bcfac06 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1214 microversion: 2.1 time: 0.368081 Aug 24 16:44:29.081257 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 14/32] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:28 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1214 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:29.110485 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1520880925", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:29.257765 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] validate_networks() for [('4d88a69f-ea66-4ba4-9592-a2ab513e73da', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:44:30.094967 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-dcd71cf4-ec1d-4450-983d-b63a0bb70bb1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:30.096310 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-dcd71cf4-ec1d-4450-983d-b63a0bb70bb1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:30.270211 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-dcd71cf4-ec1d-4450-983d-b63a0bb70bb1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:30.283411 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-dcd71cf4-ec1d-4450-983d-b63a0bb70bb1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1214 microversion: 2.1 time: 0.192158 Aug 24 16:44:30.288688 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 15/33] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:30 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:30.663682 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:44:30.664159 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:44:30.664640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:44:30.665551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:44:30.665551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:44:30.676496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:30.677354 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:30.679244 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:30.680524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:30.681995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:30.684080 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:30.709440 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Getting quotas for project c99d97707cc2485284d8d33522ebb918. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:44:30.717773 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Getting quotas for user 7be50b041b5947d5909ed6ce516ec8bf and project c99d97707cc2485284d8d33522ebb918. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:44:30.731566 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:44:30.734264 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:44:30.848912 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b8f41dc2-764e-4b16-97b7-63c7ef2fc15e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Action: 'create', calling method: .version_select at 0x7f06acba4a60>, body: {"keypair": {"name": "tempest-keypair-1962041066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM76Ujzvs9rwf0hcL5dyVnwRlTfGbrrJLHc3OXkrX6/Vbg+MNNDsMCrJMs4mdBN8g7fauDsqEupjAS2Ieldk3fryactnxg2eJhoi8bp2hybGWDFnhMD2EwXwGDRKQ8AFg=="}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:30.939517 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-b8f41dc2-764e-4b16-97b7-63c7ef2fc15e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Getting quotas for project b71890b7a23944ee939c4bd13408063f. Resources: {'key_pairs'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:44:30.947684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-344c06e4-125a-4f99-b163-2d12320cf98d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.665741 Aug 24 16:44:30.949180 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 19/34] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:44:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:44:30.959126 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-b8f41dc2-764e-4b16-97b7-63c7ef2fc15e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Getting quotas for user 4ce12f8401f3479ba14e5e1c3133a71d and project b71890b7a23944ee939c4bd13408063f. Resources: {'key_pairs'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:44:30.987532 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-294f2c03-f9e4-489e-a96b-e4a5b950889f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:30.989585 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-294f2c03-f9e4-489e-a96b-e4a5b950889f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:31.105373 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b8f41dc2-764e-4b16-97b7-63c7ef2fc15e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.815191 Aug 24 16:44:31.106359 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 16/35] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 16:44:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:31.344947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-80d82969-e09d-4e35-a794-14d2f1892a55 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:31.346033 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-80d82969-e09d-4e35-a794-14d2f1892a55 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:31.379835 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d82969-e09d-4e35-a794-14d2f1892a55 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:31.380494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d82969-e09d-4e35-a794-14d2f1892a55 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:31.381438 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d82969-e09d-4e35-a794-14d2f1892a55 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:31.383488 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d82969-e09d-4e35-a794-14d2f1892a55 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:31.397444 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d82969-e09d-4e35-a794-14d2f1892a55 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:31.403585 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d82969-e09d-4e35-a794-14d2f1892a55 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:31.414771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-294f2c03-f9e4-489e-a96b-e4a5b950889f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:31.424969 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-294f2c03-f9e4-489e-a96b-e4a5b950889f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1222 microversion: 2.1 time: 0.452406 Aug 24 16:44:31.441873 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 20/36] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:30 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1222 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:31.755029 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1860313027", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:31.905588 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] validate_networks() for [('4d88a69f-ea66-4ba4-9592-a2ab513e73da', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:44:31.932699 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-80d82969-e09d-4e35-a794-14d2f1892a55 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:31.985587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-80d82969-e09d-4e35-a794-14d2f1892a55 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1218 microversion: 2.1 time: 0.660874 Aug 24 16:44:31.989518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 17/37] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:31 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1218 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:33.025090 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f3d79ad3-ba47-4199-ab98-38188850a43a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:33.025711 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:44:33.026196 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:44:33.029080 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f3d79ad3-ba47-4199-ab98-38188850a43a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:33.033292 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:44:33.033870 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:44:33.034294 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:44:33.058123 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3d79ad3-ba47-4199-ab98-38188850a43a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:33.061101 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3d79ad3-ba47-4199-ab98-38188850a43a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:33.062231 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3d79ad3-ba47-4199-ab98-38188850a43a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:33.067271 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3d79ad3-ba47-4199-ab98-38188850a43a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:33.068630 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3d79ad3-ba47-4199-ab98-38188850a43a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:33.071602 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:33.072314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3d79ad3-ba47-4199-ab98-38188850a43a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:33.080530 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:33.081146 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:33.085681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:33.086169 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:33.086606 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:33.148244 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Getting quotas for project c99d97707cc2485284d8d33522ebb918. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:44:33.167992 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Getting quotas for user 7be50b041b5947d5909ed6ce516ec8bf and project c99d97707cc2485284d8d33522ebb918. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:44:33.214881 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:44:33.216298 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:44:33.310185 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f3d79ad3-ba47-4199-ab98-38188850a43a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:33.319854 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f3d79ad3-ba47-4199-ab98-38188850a43a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1274 microversion: 2.1 time: 0.307190 Aug 24 16:44:33.323013 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 18/38] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:33 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1274 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:33.480536 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1ddb0981-3166-40b2-89f2-f393b9b35b80 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.724909 Aug 24 16:44:33.490355 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 21/39] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:44:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:44:33.495440 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-72c24432-1bbb-4f3b-b44b-d93ef2bcebae tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:33.496059 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-72c24432-1bbb-4f3b-b44b-d93ef2bcebae tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:33.752780 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-72c24432-1bbb-4f3b-b44b-d93ef2bcebae tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:33.760695 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-72c24432-1bbb-4f3b-b44b-d93ef2bcebae tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1222 microversion: 2.1 time: 0.269871 Aug 24 16:44:33.773936 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 19/40] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:33 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1222 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:34.076518 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1580927744", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "883b1cf6-8114-4681-9877-f2163f4c86c7"}], "security_groups": [{"name": "tempest-securitygroup--1350594690"}], "key_name": "tempest-keypair-380955673", "user_data": "}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:34.347787 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1572b738-48e6-4511-b55f-272d5769895f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:34.352000 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1572b738-48e6-4511-b55f-272d5769895f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:34.373219 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1572b738-48e6-4511-b55f-272d5769895f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:34.376486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1572b738-48e6-4511-b55f-272d5769895f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:34.378773 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1572b738-48e6-4511-b55f-272d5769895f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:34.380599 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1572b738-48e6-4511-b55f-272d5769895f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:34.381303 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1572b738-48e6-4511-b55f-272d5769895f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:34.382995 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1572b738-48e6-4511-b55f-272d5769895f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:34.459300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] validate_networks() for [('883b1cf6-8114-4681-9877-f2163f4c86c7', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:44:34.676155 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1572b738-48e6-4511-b55f-272d5769895f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:34.691292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1572b738-48e6-4511-b55f-272d5769895f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1272 microversion: 2.1 time: 0.351714 Aug 24 16:44:34.712230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 20/41] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:34 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1272 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:34.786108 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a5b1f9d2-6505-4019-b5f1-3283e98432b9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:34.787271 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a5b1f9d2-6505-4019-b5f1-3283e98432b9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:35.068139 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a5b1f9d2-6505-4019-b5f1-3283e98432b9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:35.079389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a5b1f9d2-6505-4019-b5f1-3283e98432b9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1222 microversion: 2.1 time: 0.294498 Aug 24 16:44:35.082547 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 21/42] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:34 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1222 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:35.398616 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:44:35.402131 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:44:35.403739 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:44:35.409992 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:44:35.410530 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:44:35.442169 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:35.442579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:35.443368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:35.444101 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:35.444588 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:35.445327 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:35.488190 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:44:35.499818 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for user 1d9f7755863d45bfb04a1498bd62e367 and project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:44:35.521136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:44:35.523525 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:44:35.721110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-063ebc3a-629e-4584-b0a8-01cc6cebf735 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:35.721719 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-063ebc3a-629e-4584-b0a8-01cc6cebf735 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:35.737528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-063ebc3a-629e-4584-b0a8-01cc6cebf735 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:35.737528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-063ebc3a-629e-4584-b0a8-01cc6cebf735 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:35.737528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-063ebc3a-629e-4584-b0a8-01cc6cebf735 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:35.737528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-063ebc3a-629e-4584-b0a8-01cc6cebf735 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:35.748050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-063ebc3a-629e-4584-b0a8-01cc6cebf735 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:35.749781 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-063ebc3a-629e-4584-b0a8-01cc6cebf735 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:35.754653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5d5984e9-0e54-4c3e-91e0-650c63df3bf7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.695571 Aug 24 16:44:35.756926 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 22/43] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:44:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:44:35.766941 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-798acdf7-e7fc-4315-a064-3f159856dfd3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:35.767668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-798acdf7-e7fc-4315-a064-3f159856dfd3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:35.925037 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-798acdf7-e7fc-4315-a064-3f159856dfd3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:35.932048 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-798acdf7-e7fc-4315-a064-3f159856dfd3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1241 microversion: 2.1 time: 0.169269 Aug 24 16:44:35.946904 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 23/44] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:35 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1241 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:36.036663 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-063ebc3a-629e-4584-b0a8-01cc6cebf735 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:36.048695 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-063ebc3a-629e-4584-b0a8-01cc6cebf735 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1272 microversion: 2.1 time: 0.331241 Aug 24 16:44:36.050806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 22/45] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:35 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1272 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:36.101926 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-30db26da-3575-4305-b77f-d6a21251eeac tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:36.102579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-30db26da-3575-4305-b77f-d6a21251eeac tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:36.114008 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-30db26da-3575-4305-b77f-d6a21251eeac tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:36.114507 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-30db26da-3575-4305-b77f-d6a21251eeac tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:36.114949 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-30db26da-3575-4305-b77f-d6a21251eeac tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:36.115654 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-30db26da-3575-4305-b77f-d6a21251eeac tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:36.116109 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-30db26da-3575-4305-b77f-d6a21251eeac tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:36.121847 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-30db26da-3575-4305-b77f-d6a21251eeac tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:36.122311 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1255687149", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c868f21-48dd-4a80-9b52-b20f081f69bf"}], "security_groups": [{"name": "tempest-securitygroup--795939056"}], "key_name": "tempest-keypair-1962041066", "user_data": "}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:36.336046 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-30db26da-3575-4305-b77f-d6a21251eeac tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:36.353813 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-30db26da-3575-4305-b77f-d6a21251eeac tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1226 microversion: 2.1 time: 0.254832 Aug 24 16:44:36.361373 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 24/46] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:36 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1226 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:36.490059 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.network.neutron [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] validate_networks() for [('3c868f21-48dd-4a80-9b52-b20f081f69bf', None, None, None, None, None)] {{(pid=127626) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:44:36.956276 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8df4e593-da91-4643-8cdd-f7d9c34d42bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:36.958460 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8df4e593-da91-4643-8cdd-f7d9c34d42bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:37.233126 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8df4e593-da91-4643-8cdd-f7d9c34d42bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:37.240310 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8df4e593-da91-4643-8cdd-f7d9c34d42bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1241 microversion: 2.1 time: 0.290388 Aug 24 16:44:37.240935 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 25/47] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:36 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1241 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:37.264746 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ebe201a6-eb25-4329-97bd-7b63e1456e46 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:37.266307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ebe201a6-eb25-4329-97bd-7b63e1456e46 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:37.286162 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebe201a6-eb25-4329-97bd-7b63e1456e46 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:37.286668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebe201a6-eb25-4329-97bd-7b63e1456e46 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:37.287136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebe201a6-eb25-4329-97bd-7b63e1456e46 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:37.288838 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebe201a6-eb25-4329-97bd-7b63e1456e46 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:37.288838 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebe201a6-eb25-4329-97bd-7b63e1456e46 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:37.288838 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebe201a6-eb25-4329-97bd-7b63e1456e46 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:37.477006 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ebe201a6-eb25-4329-97bd-7b63e1456e46 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:37.497640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ebe201a6-eb25-4329-97bd-7b63e1456e46 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1272 microversion: 2.1 time: 0.238849 Aug 24 16:44:37.510387 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 26/48] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:37 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1272 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:37.519777 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-39b1f186-5bd5-412c-a639-2545a20a5588 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:37.520667 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-39b1f186-5bd5-412c-a639-2545a20a5588 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:37.537455 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39b1f186-5bd5-412c-a639-2545a20a5588 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:37.545986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39b1f186-5bd5-412c-a639-2545a20a5588 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:37.546603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39b1f186-5bd5-412c-a639-2545a20a5588 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:37.547670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39b1f186-5bd5-412c-a639-2545a20a5588 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:37.548251 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39b1f186-5bd5-412c-a639-2545a20a5588 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:37.548849 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39b1f186-5bd5-412c-a639-2545a20a5588 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:37.750050 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-39b1f186-5bd5-412c-a639-2545a20a5588 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:37.762614 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-39b1f186-5bd5-412c-a639-2545a20a5588 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1274 microversion: 2.1 time: 0.250832 Aug 24 16:44:37.763320 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 27/49] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:37 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1274 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:38.263767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6735ada2-7037-4010-a3a2-edae91589fcb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:38.264672 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6735ada2-7037-4010-a3a2-edae91589fcb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:38.281336 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6735ada2-7037-4010-a3a2-edae91589fcb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:38.286725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6735ada2-7037-4010-a3a2-edae91589fcb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:38.286725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6735ada2-7037-4010-a3a2-edae91589fcb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:38.286725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6735ada2-7037-4010-a3a2-edae91589fcb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:38.286725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6735ada2-7037-4010-a3a2-edae91589fcb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:38.287381 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6735ada2-7037-4010-a3a2-edae91589fcb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:38.595326 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Flavor limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:44:38.624658 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Image limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:44:38.624658 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Flavor pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:44:38.624658 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Image pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:44:38.624658 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:44:38.624658 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:38.625611 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:38.625611 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:38.625611 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:38.625611 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:38.626015 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:38.642696 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6735ada2-7037-4010-a3a2-edae91589fcb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:38.657373 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6735ada2-7037-4010-a3a2-edae91589fcb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1245 microversion: 2.1 time: 0.398965 Aug 24 16:44:38.674420 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 28/50] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:38 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1245 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:38.686702 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1b0fdfab-219d-44d0-931e-2b531593db52 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:38.693213 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1b0fdfab-219d-44d0-931e-2b531593db52 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:38.704630 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b0fdfab-219d-44d0-931e-2b531593db52 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:38.705140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b0fdfab-219d-44d0-931e-2b531593db52 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:38.705567 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b0fdfab-219d-44d0-931e-2b531593db52 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:38.708473 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b0fdfab-219d-44d0-931e-2b531593db52 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:38.710323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b0fdfab-219d-44d0-931e-2b531593db52 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:38.710902 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b0fdfab-219d-44d0-931e-2b531593db52 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:38.730125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Getting quotas for project b71890b7a23944ee939c4bd13408063f. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:44:38.749913 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Getting quotas for user 4ce12f8401f3479ba14e5e1c3133a71d and project b71890b7a23944ee939c4bd13408063f. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:44:38.769216 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Going to run 1 instances... {{(pid=127626) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:44:38.788994 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:44:39.192957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1b0fdfab-219d-44d0-931e-2b531593db52 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:39.212836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1b0fdfab-219d-44d0-931e-2b531593db52 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.534382 Aug 24 16:44:39.215984 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 29/51] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:38 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:39.236293 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8a1907d4-3e27-4513-bf88-0cfc77527382 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:39.237200 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8a1907d4-3e27-4513-bf88-0cfc77527382 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:39.261947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d909c54f-09a9-456f-9a1b-782f89140d09 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.149601 Aug 24 16:44:39.262606 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 23/52] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:44:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 3151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:44:39.271805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a1907d4-3e27-4513-bf88-0cfc77527382 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:39.272384 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a1907d4-3e27-4513-bf88-0cfc77527382 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:39.272767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a1907d4-3e27-4513-bf88-0cfc77527382 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:39.273464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a1907d4-3e27-4513-bf88-0cfc77527382 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:39.273911 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a1907d4-3e27-4513-bf88-0cfc77527382 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:39.274460 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a1907d4-3e27-4513-bf88-0cfc77527382 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:39.274668 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7425c494-2f14-472f-9d1b-0b5cd1c22961 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:39.275471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7425c494-2f14-472f-9d1b-0b5cd1c22961 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:39.489083 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7425c494-2f14-472f-9d1b-0b5cd1c22961 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:39.498615 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7425c494-2f14-472f-9d1b-0b5cd1c22961 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1238 microversion: 2.1 time: 0.228420 Aug 24 16:44:39.513550 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 24/53] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:39 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1238 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:39.581278 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8a1907d4-3e27-4513-bf88-0cfc77527382 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:39.596014 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8a1907d4-3e27-4513-bf88-0cfc77527382 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1282 microversion: 2.1 time: 0.378016 Aug 24 16:44:39.596640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 30/54] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:39 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1282 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:39.688254 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-aeb3af4a-8016-4450-ba70-51c7f585e438 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:39.689519 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-aeb3af4a-8016-4450-ba70-51c7f585e438 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:39.714492 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeb3af4a-8016-4450-ba70-51c7f585e438 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:39.715099 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeb3af4a-8016-4450-ba70-51c7f585e438 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:39.715629 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeb3af4a-8016-4450-ba70-51c7f585e438 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:39.719141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeb3af4a-8016-4450-ba70-51c7f585e438 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:39.719731 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeb3af4a-8016-4450-ba70-51c7f585e438 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:39.720195 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeb3af4a-8016-4450-ba70-51c7f585e438 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:39.922410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-aeb3af4a-8016-4450-ba70-51c7f585e438 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:39.936822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-aeb3af4a-8016-4450-ba70-51c7f585e438 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1293 microversion: 2.1 time: 0.248524 Aug 24 16:44:39.936822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 25/55] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:39 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1293 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:40.245604 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-45604004-9ab4-49cb-add0-83a8b5ec3d3d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:40.246302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-45604004-9ab4-49cb-add0-83a8b5ec3d3d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:40.261390 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45604004-9ab4-49cb-add0-83a8b5ec3d3d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:40.261907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45604004-9ab4-49cb-add0-83a8b5ec3d3d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:40.263503 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45604004-9ab4-49cb-add0-83a8b5ec3d3d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:40.264399 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45604004-9ab4-49cb-add0-83a8b5ec3d3d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:40.273459 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45604004-9ab4-49cb-add0-83a8b5ec3d3d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:40.279586 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45604004-9ab4-49cb-add0-83a8b5ec3d3d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:40.521982 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-17fdc311-4b13-4ad9-85f6-e1ba591cd1b1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:40.522606 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-17fdc311-4b13-4ad9-85f6-e1ba591cd1b1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:40.612667 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-45604004-9ab4-49cb-add0-83a8b5ec3d3d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:40.636011 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-45604004-9ab4-49cb-add0-83a8b5ec3d3d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.400672 Aug 24 16:44:40.637409 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 31/56] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:40 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:40.644186 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bc239d75-ee33-4052-8525-919561a69747 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:40.645063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bc239d75-ee33-4052-8525-919561a69747 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:40.667286 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-17fdc311-4b13-4ad9-85f6-e1ba591cd1b1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:40.669411 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc239d75-ee33-4052-8525-919561a69747 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:40.670394 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc239d75-ee33-4052-8525-919561a69747 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:40.675539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc239d75-ee33-4052-8525-919561a69747 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:40.676780 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc239d75-ee33-4052-8525-919561a69747 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:40.680230 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc239d75-ee33-4052-8525-919561a69747 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:40.681613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc239d75-ee33-4052-8525-919561a69747 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:40.690807 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-17fdc311-4b13-4ad9-85f6-e1ba591cd1b1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1238 microversion: 2.1 time: 0.172744 Aug 24 16:44:40.692444 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 26/57] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:40 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1238 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:40.911177 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bc239d75-ee33-4052-8525-919561a69747 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:40.925644 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bc239d75-ee33-4052-8525-919561a69747 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1280 microversion: 2.1 time: 0.283756 Aug 24 16:44:40.928479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 32/58] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:40 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1280 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:40.960139 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-bc5edf1e-e3b6-445c-9490-70578eb2112b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:40.961148 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-bc5edf1e-e3b6-445c-9490-70578eb2112b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:41.067387 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc5edf1e-e3b6-445c-9490-70578eb2112b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:41.067387 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc5edf1e-e3b6-445c-9490-70578eb2112b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:41.067387 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc5edf1e-e3b6-445c-9490-70578eb2112b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:41.067387 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc5edf1e-e3b6-445c-9490-70578eb2112b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:41.067747 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc5edf1e-e3b6-445c-9490-70578eb2112b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:41.067747 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc5edf1e-e3b6-445c-9490-70578eb2112b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:41.202249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-bc5edf1e-e3b6-445c-9490-70578eb2112b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:41.210812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-bc5edf1e-e3b6-445c-9490-70578eb2112b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1301 microversion: 2.1 time: 0.255629 Aug 24 16:44:41.214870 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 27/59] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:40 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1301 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:41.657730 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3cf17aa1-cee1-4839-aff7-d54bb56b9ae6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:41.658550 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3cf17aa1-cee1-4839-aff7-d54bb56b9ae6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:41.663181 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:41.667403 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf17aa1-cee1-4839-aff7-d54bb56b9ae6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:41.667890 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf17aa1-cee1-4839-aff7-d54bb56b9ae6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:41.668319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf17aa1-cee1-4839-aff7-d54bb56b9ae6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:41.678753 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf17aa1-cee1-4839-aff7-d54bb56b9ae6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:41.680120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf17aa1-cee1-4839-aff7-d54bb56b9ae6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:41.682656 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf17aa1-cee1-4839-aff7-d54bb56b9ae6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:41.716182 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-99f0fd77-2805-485d-ba26-317505fb2f10 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:41.718363 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-99f0fd77-2805-485d-ba26-317505fb2f10 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:41.744608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99f0fd77-2805-485d-ba26-317505fb2f10 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:41.744608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99f0fd77-2805-485d-ba26-317505fb2f10 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:41.750825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99f0fd77-2805-485d-ba26-317505fb2f10 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:41.755211 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99f0fd77-2805-485d-ba26-317505fb2f10 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:41.756727 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99f0fd77-2805-485d-ba26-317505fb2f10 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:41.758319 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99f0fd77-2805-485d-ba26-317505fb2f10 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:42.059905 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-99f0fd77-2805-485d-ba26-317505fb2f10 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:42.093100 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-99f0fd77-2805-485d-ba26-317505fb2f10 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1242 microversion: 2.1 time: 0.380919 Aug 24 16:44:42.095443 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 28/60] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:41 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1242 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:42.108738 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a2a6e85f-3ac2-4729-94a8-dab57145d5a5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:42.109545 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a2a6e85f-3ac2-4729-94a8-dab57145d5a5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:42.126336 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2a6e85f-3ac2-4729-94a8-dab57145d5a5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:42.126884 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2a6e85f-3ac2-4729-94a8-dab57145d5a5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:42.127328 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2a6e85f-3ac2-4729-94a8-dab57145d5a5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:42.128043 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2a6e85f-3ac2-4729-94a8-dab57145d5a5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:42.128581 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2a6e85f-3ac2-4729-94a8-dab57145d5a5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:42.129139 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2a6e85f-3ac2-4729-94a8-dab57145d5a5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:42.408657 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a2a6e85f-3ac2-4729-94a8-dab57145d5a5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:42.442046 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a2a6e85f-3ac2-4729-94a8-dab57145d5a5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1280 microversion: 2.1 time: 0.334888 Aug 24 16:44:42.442046 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 29/61] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:42 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:42.450642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3cf17aa1-cee1-4839-aff7-d54bb56b9ae6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:42.458410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3cf17aa1-cee1-4839-aff7-d54bb56b9ae6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.804724 Aug 24 16:44:42.462614 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 33/62] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:41 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:42.468009 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4ce8a33c-8d12-47bf-8a7c-d224ea2e614f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:42.475178 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4ce8a33c-8d12-47bf-8a7c-d224ea2e614f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:42.503294 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce8a33c-8d12-47bf-8a7c-d224ea2e614f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:42.505193 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce8a33c-8d12-47bf-8a7c-d224ea2e614f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:42.506203 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce8a33c-8d12-47bf-8a7c-d224ea2e614f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:42.508906 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce8a33c-8d12-47bf-8a7c-d224ea2e614f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:42.509608 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce8a33c-8d12-47bf-8a7c-d224ea2e614f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:42.511431 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce8a33c-8d12-47bf-8a7c-d224ea2e614f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:42.591034 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-62f8e046-ce64-4755-9a62-b119e8279c68 req-cd21f3ce-b6bb-427f-9c15-a6f3dd09c584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "571bde76-f97b-4358-be97-b61869ac0da5", "tag": "94b5e105-7d98-45d8-b2c9-df6e9dd14d9f"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:42.619725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-62f8e046-ce64-4755-9a62-b119e8279c68 req-cd21f3ce-b6bb-427f-9c15-a6f3dd09c584 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:42.620219 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-62f8e046-ce64-4755-9a62-b119e8279c68 req-cd21f3ce-b6bb-427f-9c15-a6f3dd09c584 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:42.621586 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-62f8e046-ce64-4755-9a62-b119e8279c68 req-cd21f3ce-b6bb-427f-9c15-a6f3dd09c584 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:42.662148 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4ce8a33c-8d12-47bf-8a7c-d224ea2e614f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:42.672086 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-62f8e046-ce64-4755-9a62-b119e8279c68 req-cd21f3ce-b6bb-427f-9c15-a6f3dd09c584 service nova] Creating event network-changed:94b5e105-7d98-45d8-b2c9-df6e9dd14d9f for instance 571bde76-f97b-4358-be97-b61869ac0da5 on hv-cinder-73116 Aug 24 16:44:42.676699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4ce8a33c-8d12-47bf-8a7c-d224ea2e614f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1299 microversion: 2.1 time: 0.212489 Aug 24 16:44:42.690343 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-62f8e046-ce64-4755-9a62-b119e8279c68 req-cd21f3ce-b6bb-427f-9c15-a6f3dd09c584 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 16:44:42.690343 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-62f8e046-ce64-4755-9a62-b119e8279c68 req-cd21f3ce-b6bb-427f-9c15-a6f3dd09c584 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 16:44:42.690343 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d9b5997-6e24-4e82-9a9a-b7b80fadac84 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:42.690343 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d9b5997-6e24-4e82-9a9a-b7b80fadac84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:42.690343 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d9b5997-6e24-4e82-9a9a-b7b80fadac84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:42.690739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d9b5997-6e24-4e82-9a9a-b7b80fadac84 None None] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:42.690739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d9b5997-6e24-4e82-9a9a-b7b80fadac84 None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:42.690739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d9b5997-6e24-4e82-9a9a-b7b80fadac84 None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:42.690926 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 34/63] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:42 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1299 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:42.693264 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.compute.rpcapi [None req-6d9b5997-6e24-4e82-9a9a-b7b80fadac84 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 16:44:42.694197 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d9b5997-6e24-4e82-9a9a-b7b80fadac84 None None] Releasing lock "compute-rpcapi-router" {{(pid=127626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 16:44:42.709485 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6d9b5997-6e24-4e82-9a9a-b7b80fadac84 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272836 Aug 24 16:44:42.712117 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 30/64] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:43.118118 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-584d7150-0fc2-4b92-8eb7-022fce44c0bf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:43.122885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-584d7150-0fc2-4b92-8eb7-022fce44c0bf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:43.134264 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-584d7150-0fc2-4b92-8eb7-022fce44c0bf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:43.134794 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-584d7150-0fc2-4b92-8eb7-022fce44c0bf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:43.136637 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-584d7150-0fc2-4b92-8eb7-022fce44c0bf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:43.138340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-584d7150-0fc2-4b92-8eb7-022fce44c0bf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:43.139209 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-584d7150-0fc2-4b92-8eb7-022fce44c0bf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:43.139309 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-584d7150-0fc2-4b92-8eb7-022fce44c0bf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:43.257826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-584d7150-0fc2-4b92-8eb7-022fce44c0bf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:43.270680 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-584d7150-0fc2-4b92-8eb7-022fce44c0bf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1290 microversion: 2.1 time: 0.157151 Aug 24 16:44:43.284265 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 35/65] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:43 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1290 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:43.462750 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0979fe3e-20d9-4ec6-963b-8af0360b5855 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:43.464058 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0979fe3e-20d9-4ec6-963b-8af0360b5855 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:43.473594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0979fe3e-20d9-4ec6-963b-8af0360b5855 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:43.479397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0979fe3e-20d9-4ec6-963b-8af0360b5855 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:43.479397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0979fe3e-20d9-4ec6-963b-8af0360b5855 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:43.479397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0979fe3e-20d9-4ec6-963b-8af0360b5855 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:43.479397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0979fe3e-20d9-4ec6-963b-8af0360b5855 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:43.479971 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0979fe3e-20d9-4ec6-963b-8af0360b5855 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:43.484559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4cf49dfd-0d1d-4345-84ea-4eaba64066d8 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:43.485158 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4cf49dfd-0d1d-4345-84ea-4eaba64066d8 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:43.493934 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4cf49dfd-0d1d-4345-84ea-4eaba64066d8 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:43.496419 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4cf49dfd-0d1d-4345-84ea-4eaba64066d8 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:43.497019 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4cf49dfd-0d1d-4345-84ea-4eaba64066d8 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:43.498215 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4cf49dfd-0d1d-4345-84ea-4eaba64066d8 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:43.498803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4cf49dfd-0d1d-4345-84ea-4eaba64066d8 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:43.499536 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4cf49dfd-0d1d-4345-84ea-4eaba64066d8 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:43.764219 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4cf49dfd-0d1d-4345-84ea-4eaba64066d8 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:43.776879 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4cf49dfd-0d1d-4345-84ea-4eaba64066d8 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.295995 Aug 24 16:44:43.792586 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 36/66] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:43 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:43.798602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0979fe3e-20d9-4ec6-963b-8af0360b5855 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:43.805144 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-17519e36-3cfa-4f92-9d27-4ec449bd509d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:43.806268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-17519e36-3cfa-4f92-9d27-4ec449bd509d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:43.812125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0979fe3e-20d9-4ec6-963b-8af0360b5855 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.354505 Aug 24 16:44:43.813011 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 31/67] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:43 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:43.825868 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17519e36-3cfa-4f92-9d27-4ec449bd509d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:43.825868 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17519e36-3cfa-4f92-9d27-4ec449bd509d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:43.825868 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17519e36-3cfa-4f92-9d27-4ec449bd509d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:43.825868 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17519e36-3cfa-4f92-9d27-4ec449bd509d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:43.826339 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17519e36-3cfa-4f92-9d27-4ec449bd509d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:43.826339 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17519e36-3cfa-4f92-9d27-4ec449bd509d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:43.889301 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-17519e36-3cfa-4f92-9d27-4ec449bd509d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:43.901227 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-17519e36-3cfa-4f92-9d27-4ec449bd509d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1299 microversion: 2.1 time: 0.106978 Aug 24 16:44:43.901548 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 37/68] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:43 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:44.296598 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-66c33a36-bee0-4cce-be66-04c88319c2cf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:44.297271 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-66c33a36-bee0-4cce-be66-04c88319c2cf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:44.307552 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c33a36-bee0-4cce-be66-04c88319c2cf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:44.308230 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c33a36-bee0-4cce-be66-04c88319c2cf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:44.309622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c33a36-bee0-4cce-be66-04c88319c2cf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:44.310891 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c33a36-bee0-4cce-be66-04c88319c2cf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:44.313158 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c33a36-bee0-4cce-be66-04c88319c2cf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:44.325300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c33a36-bee0-4cce-be66-04c88319c2cf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:44.419297 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-d39e6d4e-6ab2-4085-a06c-d608f971959d req-00b5b1bb-4291-4599-bddf-c1abf413d06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "033273ba-5c67-47d7-8191-7aa0388f87dc", "tag": "08c8eeee-cfbe-4e3e-9514-c73d861d88db"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:44.434125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d39e6d4e-6ab2-4085-a06c-d608f971959d req-00b5b1bb-4291-4599-bddf-c1abf413d06d service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:44.434617 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d39e6d4e-6ab2-4085-a06c-d608f971959d req-00b5b1bb-4291-4599-bddf-c1abf413d06d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:44.435048 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d39e6d4e-6ab2-4085-a06c-d608f971959d req-00b5b1bb-4291-4599-bddf-c1abf413d06d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:44.440774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-66c33a36-bee0-4cce-be66-04c88319c2cf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:44.453700 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-66c33a36-bee0-4cce-be66-04c88319c2cf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1290 microversion: 2.1 time: 0.160820 Aug 24 16:44:44.453700 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 38/69] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:44 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1290 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:44.476572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-d39e6d4e-6ab2-4085-a06c-d608f971959d req-00b5b1bb-4291-4599-bddf-c1abf413d06d service nova] Creating event network-changed:08c8eeee-cfbe-4e3e-9514-c73d861d88db for instance 033273ba-5c67-47d7-8191-7aa0388f87dc on hv-cinder-73116 Aug 24 16:44:44.482614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-d39e6d4e-6ab2-4085-a06c-d608f971959d req-00b5b1bb-4291-4599-bddf-c1abf413d06d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285481 Aug 24 16:44:44.483333 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 32/70] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:44.802600 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b662ce5c-d788-410e-9902-5eb315adb03f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:44.802600 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b662ce5c-d788-410e-9902-5eb315adb03f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:44.807258 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b662ce5c-d788-410e-9902-5eb315adb03f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:44.807749 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b662ce5c-d788-410e-9902-5eb315adb03f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:44.808174 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b662ce5c-d788-410e-9902-5eb315adb03f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:44.811380 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b662ce5c-d788-410e-9902-5eb315adb03f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:44.812632 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b662ce5c-d788-410e-9902-5eb315adb03f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:44.813687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b662ce5c-d788-410e-9902-5eb315adb03f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:44.834095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-fbf7bfa3-a62d-42a5-b64c-22bafe311018 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:44.835070 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-fbf7bfa3-a62d-42a5-b64c-22bafe311018 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:44.852767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fbf7bfa3-a62d-42a5-b64c-22bafe311018 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:44.859945 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fbf7bfa3-a62d-42a5-b64c-22bafe311018 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:44.859945 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fbf7bfa3-a62d-42a5-b64c-22bafe311018 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:44.859945 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fbf7bfa3-a62d-42a5-b64c-22bafe311018 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:44.859945 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fbf7bfa3-a62d-42a5-b64c-22bafe311018 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:44.860419 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fbf7bfa3-a62d-42a5-b64c-22bafe311018 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:45.018937 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b662ce5c-d788-410e-9902-5eb315adb03f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:45.026901 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b662ce5c-d788-410e-9902-5eb315adb03f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.231328 Aug 24 16:44:45.027408 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 39/71] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:44 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:45.031996 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2549905d-5381-4b97-89bc-1f06ba37c6d3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:45.032623 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2549905d-5381-4b97-89bc-1f06ba37c6d3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:45.038398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2549905d-5381-4b97-89bc-1f06ba37c6d3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:45.038885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2549905d-5381-4b97-89bc-1f06ba37c6d3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:45.039352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2549905d-5381-4b97-89bc-1f06ba37c6d3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:45.040157 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2549905d-5381-4b97-89bc-1f06ba37c6d3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:45.041159 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2549905d-5381-4b97-89bc-1f06ba37c6d3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:45.041159 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2549905d-5381-4b97-89bc-1f06ba37c6d3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:45.046063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:45.056168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fbf7bfa3-a62d-42a5-b64c-22bafe311018 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:45.064267 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-fbf7bfa3-a62d-42a5-b64c-22bafe311018 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.234284 Aug 24 16:44:45.070073 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 33/72] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:44 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:45.195323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2549905d-5381-4b97-89bc-1f06ba37c6d3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:45.203968 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2549905d-5381-4b97-89bc-1f06ba37c6d3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.175505 Aug 24 16:44:45.204592 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 40/73] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:45 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:45.477277 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-49872329-ee98-4aa0-a700-7026e282021e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:45.479218 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-49872329-ee98-4aa0-a700-7026e282021e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:45.486086 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49872329-ee98-4aa0-a700-7026e282021e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:45.486805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49872329-ee98-4aa0-a700-7026e282021e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:45.487416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49872329-ee98-4aa0-a700-7026e282021e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:45.488589 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49872329-ee98-4aa0-a700-7026e282021e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:45.489213 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49872329-ee98-4aa0-a700-7026e282021e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:45.489821 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49872329-ee98-4aa0-a700-7026e282021e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:45.573496 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-49872329-ee98-4aa0-a700-7026e282021e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:45.582054 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-49872329-ee98-4aa0-a700-7026e282021e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1290 microversion: 2.1 time: 0.109013 Aug 24 16:44:45.583189 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 34/74] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:45 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:46.067575 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1d21dced-64f4-4a5f-bd6c-032ddedf9cc6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:46.068954 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1d21dced-64f4-4a5f-bd6c-032ddedf9cc6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:46.075702 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=8 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:46.083266 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d21dced-64f4-4a5f-bd6c-032ddedf9cc6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:46.084186 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d21dced-64f4-4a5f-bd6c-032ddedf9cc6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:46.085033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d21dced-64f4-4a5f-bd6c-032ddedf9cc6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:46.086681 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-da2eff19-c213-4ff4-ad31-c56bb423c0db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:46.087415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-da2eff19-c213-4ff4-ad31-c56bb423c0db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:46.087528 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d21dced-64f4-4a5f-bd6c-032ddedf9cc6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:46.088115 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d21dced-64f4-4a5f-bd6c-032ddedf9cc6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:46.088901 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d21dced-64f4-4a5f-bd6c-032ddedf9cc6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:46.099979 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-da2eff19-c213-4ff4-ad31-c56bb423c0db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:46.100968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-da2eff19-c213-4ff4-ad31-c56bb423c0db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:46.103396 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-da2eff19-c213-4ff4-ad31-c56bb423c0db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:46.111448 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-da2eff19-c213-4ff4-ad31-c56bb423c0db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:46.111448 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-da2eff19-c213-4ff4-ad31-c56bb423c0db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:46.111448 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-da2eff19-c213-4ff4-ad31-c56bb423c0db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:46.393860 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1d21dced-64f4-4a5f-bd6c-032ddedf9cc6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:46.407516 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1d21dced-64f4-4a5f-bd6c-032ddedf9cc6 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.363343 Aug 24 16:44:46.420393 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 41/75] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:46 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:46.420393 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1a4399f1-8e37-4e91-8522-65b55b13e293 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:46.420859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1a4399f1-8e37-4e91-8522-65b55b13e293 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:46.434278 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a4399f1-8e37-4e91-8522-65b55b13e293 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:46.435391 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a4399f1-8e37-4e91-8522-65b55b13e293 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:46.436010 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a4399f1-8e37-4e91-8522-65b55b13e293 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:46.437011 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a4399f1-8e37-4e91-8522-65b55b13e293 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:46.437625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a4399f1-8e37-4e91-8522-65b55b13e293 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:46.438197 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a4399f1-8e37-4e91-8522-65b55b13e293 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:46.440155 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-da2eff19-c213-4ff4-ad31-c56bb423c0db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:46.458005 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-da2eff19-c213-4ff4-ad31-c56bb423c0db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.375859 Aug 24 16:44:46.460878 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 35/76] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:46 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:46.606282 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e892cddc-218f-4e9c-a68f-5a19fc796d65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:46.607502 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e892cddc-218f-4e9c-a68f-5a19fc796d65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:46.612221 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:46.623039 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e892cddc-218f-4e9c-a68f-5a19fc796d65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:46.623546 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e892cddc-218f-4e9c-a68f-5a19fc796d65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:46.625825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e892cddc-218f-4e9c-a68f-5a19fc796d65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:46.627326 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e892cddc-218f-4e9c-a68f-5a19fc796d65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:46.629683 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e892cddc-218f-4e9c-a68f-5a19fc796d65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:46.630301 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e892cddc-218f-4e9c-a68f-5a19fc796d65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:46.655967 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1a4399f1-8e37-4e91-8522-65b55b13e293 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:46.667300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1a4399f1-8e37-4e91-8522-65b55b13e293 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.255730 Aug 24 16:44:46.670516 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 42/77] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:46 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:46.829309 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e892cddc-218f-4e9c-a68f-5a19fc796d65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:46.841772 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e892cddc-218f-4e9c-a68f-5a19fc796d65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1290 microversion: 2.1 time: 0.241297 Aug 24 16:44:46.842644 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 36/78] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:46 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1290 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:47.433106 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-269a79db-47b6-43ed-bd92-86fba9e3e8b4 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:47.433721 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-269a79db-47b6-43ed-bd92-86fba9e3e8b4 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:47.436844 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=32 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:47.444236 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-269a79db-47b6-43ed-bd92-86fba9e3e8b4 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:47.445378 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-269a79db-47b6-43ed-bd92-86fba9e3e8b4 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:47.447017 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-269a79db-47b6-43ed-bd92-86fba9e3e8b4 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:47.448433 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-269a79db-47b6-43ed-bd92-86fba9e3e8b4 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:47.450950 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-269a79db-47b6-43ed-bd92-86fba9e3e8b4 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:47.450950 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-269a79db-47b6-43ed-bd92-86fba9e3e8b4 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:47.486088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-53123a28-de41-4680-8524-0daa9774a563 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:47.486088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-53123a28-de41-4680-8524-0daa9774a563 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:47.498029 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-53123a28-de41-4680-8524-0daa9774a563 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:47.505578 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-53123a28-de41-4680-8524-0daa9774a563 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:47.505578 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-53123a28-de41-4680-8524-0daa9774a563 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:47.505578 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-53123a28-de41-4680-8524-0daa9774a563 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:47.505578 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-53123a28-de41-4680-8524-0daa9774a563 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:47.505952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-53123a28-de41-4680-8524-0daa9774a563 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:48.069372 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-269a79db-47b6-43ed-bd92-86fba9e3e8b4 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:48.084098 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-269a79db-47b6-43ed-bd92-86fba9e3e8b4 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.652368 Aug 24 16:44:48.112839 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 43/79] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:47 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:48.120262 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ee1689ae-2db1-4272-994c-c2f66009f36b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:48.129319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ee1689ae-2db1-4272-994c-c2f66009f36b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:48.147668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee1689ae-2db1-4272-994c-c2f66009f36b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:48.148170 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee1689ae-2db1-4272-994c-c2f66009f36b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:48.149306 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee1689ae-2db1-4272-994c-c2f66009f36b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:48.150795 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee1689ae-2db1-4272-994c-c2f66009f36b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:48.151415 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee1689ae-2db1-4272-994c-c2f66009f36b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:48.151985 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee1689ae-2db1-4272-994c-c2f66009f36b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:48.273099 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-53123a28-de41-4680-8524-0daa9774a563 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:48.291103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-53123a28-de41-4680-8524-0daa9774a563 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.811924 Aug 24 16:44:48.291649 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 37/80] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:47 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:48.312987 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b58b6653-f749-460a-b6bc-90f0486ad9c2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:48.313764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b58b6653-f749-460a-b6bc-90f0486ad9c2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:48.334581 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b58b6653-f749-460a-b6bc-90f0486ad9c2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:48.353280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b58b6653-f749-460a-b6bc-90f0486ad9c2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:48.356947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b58b6653-f749-460a-b6bc-90f0486ad9c2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:48.358053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b58b6653-f749-460a-b6bc-90f0486ad9c2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:48.358675 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b58b6653-f749-460a-b6bc-90f0486ad9c2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:48.359373 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b58b6653-f749-460a-b6bc-90f0486ad9c2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:48.672360 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b58b6653-f749-460a-b6bc-90f0486ad9c2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:48.691646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b58b6653-f749-460a-b6bc-90f0486ad9c2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1296 microversion: 2.1 time: 0.393540 Aug 24 16:44:48.692798 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 38/81] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:48 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1296 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:48.944287 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ee1689ae-2db1-4272-994c-c2f66009f36b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:48.960222 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ee1689ae-2db1-4272-994c-c2f66009f36b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.845593 Aug 24 16:44:48.984939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 44/82] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:48 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:49.116622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-06fc22f9-a029-4fe6-a8aa-e2a6074cbf9f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:49.117524 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-06fc22f9-a029-4fe6-a8aa-e2a6074cbf9f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:49.144753 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06fc22f9-a029-4fe6-a8aa-e2a6074cbf9f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:49.144753 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06fc22f9-a029-4fe6-a8aa-e2a6074cbf9f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:49.144753 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06fc22f9-a029-4fe6-a8aa-e2a6074cbf9f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:49.144753 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06fc22f9-a029-4fe6-a8aa-e2a6074cbf9f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:49.145083 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06fc22f9-a029-4fe6-a8aa-e2a6074cbf9f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:49.145083 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06fc22f9-a029-4fe6-a8aa-e2a6074cbf9f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:49.161475 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=100 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:49.311910 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-944c0e36-5759-4cff-9425-e4db284eacb7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:49.312770 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-944c0e36-5759-4cff-9425-e4db284eacb7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:49.319588 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-944c0e36-5759-4cff-9425-e4db284eacb7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:49.323044 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-944c0e36-5759-4cff-9425-e4db284eacb7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:49.324714 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-944c0e36-5759-4cff-9425-e4db284eacb7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:49.328309 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-944c0e36-5759-4cff-9425-e4db284eacb7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:49.329194 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-944c0e36-5759-4cff-9425-e4db284eacb7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:49.329933 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-944c0e36-5759-4cff-9425-e4db284eacb7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:50.260487 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-944c0e36-5759-4cff-9425-e4db284eacb7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:50.270151 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-944c0e36-5759-4cff-9425-e4db284eacb7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.962194 Aug 24 16:44:50.276202 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 45/83] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:49 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:50.287725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0eedd717-4774-4a66-9f73-a5f3705195f3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:50.290432 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0eedd717-4774-4a66-9f73-a5f3705195f3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:50.301825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-06fc22f9-a029-4fe6-a8aa-e2a6074cbf9f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:50.306123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0eedd717-4774-4a66-9f73-a5f3705195f3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:50.308104 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0eedd717-4774-4a66-9f73-a5f3705195f3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:50.308585 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0eedd717-4774-4a66-9f73-a5f3705195f3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:50.309414 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0eedd717-4774-4a66-9f73-a5f3705195f3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:50.312816 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0eedd717-4774-4a66-9f73-a5f3705195f3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:50.313302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0eedd717-4774-4a66-9f73-a5f3705195f3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:50.318054 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-06fc22f9-a029-4fe6-a8aa-e2a6074cbf9f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 1.207693 Aug 24 16:44:50.324449 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 39/84] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:49 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:50.337170 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-430cf117-0c6e-49fd-840f-afeb341078f1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:50.340239 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-430cf117-0c6e-49fd-840f-afeb341078f1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:50.363473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430cf117-0c6e-49fd-840f-afeb341078f1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:50.366704 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430cf117-0c6e-49fd-840f-afeb341078f1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:50.367722 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430cf117-0c6e-49fd-840f-afeb341078f1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:50.371247 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430cf117-0c6e-49fd-840f-afeb341078f1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:50.373051 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430cf117-0c6e-49fd-840f-afeb341078f1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:50.373717 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430cf117-0c6e-49fd-840f-afeb341078f1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:50.613717 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0eedd717-4774-4a66-9f73-a5f3705195f3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:50.629420 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0eedd717-4774-4a66-9f73-a5f3705195f3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1296 microversion: 2.1 time: 0.351196 Aug 24 16:44:50.644492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 46/85] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:50 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1296 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:50.658456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-d43c49cc-b05b-49c0-8aab-15c88c14e960 req-b2961a45-9ea0-4aff-866d-946e8e032ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c63f0ac-d4f8-499f-8901-53d4dbbc15ac", "tag": "fefa6a59-cba3-43bd-99e5-f25c064dc3ea"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:50.680391 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=28 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:50.685301 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-d43c49cc-b05b-49c0-8aab-15c88c14e960 req-b2961a45-9ea0-4aff-866d-946e8e032ad9 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:50.686016 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-d43c49cc-b05b-49c0-8aab-15c88c14e960 req-b2961a45-9ea0-4aff-866d-946e8e032ad9 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:50.686637 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-d43c49cc-b05b-49c0-8aab-15c88c14e960 req-b2961a45-9ea0-4aff-866d-946e8e032ad9 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:50.714094 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-d43c49cc-b05b-49c0-8aab-15c88c14e960 req-b2961a45-9ea0-4aff-866d-946e8e032ad9 service nova] Creating event network-changed:fefa6a59-cba3-43bd-99e5-f25c064dc3ea for instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac on hv-cinder-73116 Aug 24 16:44:50.715272 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-d43c49cc-b05b-49c0-8aab-15c88c14e960 req-b2961a45-9ea0-4aff-866d-946e8e032ad9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127627) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 16:44:50.715849 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-d43c49cc-b05b-49c0-8aab-15c88c14e960 req-b2961a45-9ea0-4aff-866d-946e8e032ad9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127627) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 16:44:50.717304 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2aa2c93-3d86-45e8-a245-725193e348d4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:50.717970 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2aa2c93-3d86-45e8-a245-725193e348d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:50.718739 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2aa2c93-3d86-45e8-a245-725193e348d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:50.719711 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2aa2c93-3d86-45e8-a245-725193e348d4 None None] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:50.720407 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2aa2c93-3d86-45e8-a245-725193e348d4 None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:50.721035 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2aa2c93-3d86-45e8-a245-725193e348d4 None None] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:50.736087 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.compute.rpcapi [None req-f2aa2c93-3d86-45e8-a245-725193e348d4 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 16:44:50.738178 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2aa2c93-3d86-45e8-a245-725193e348d4 None None] Releasing lock "compute-rpcapi-router" {{(pid=127627) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 16:44:50.776045 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f2aa2c93-3d86-45e8-a245-725193e348d4 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136208 Aug 24 16:44:50.776964 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 47/86] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:51.062676 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-430cf117-0c6e-49fd-840f-afeb341078f1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:51.079450 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-430cf117-0c6e-49fd-840f-afeb341078f1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.754071 Aug 24 16:44:51.089382 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 40/87] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:50 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:51.297196 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d0ece9be-d974-4a26-827f-26f4c029773a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:51.297918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d0ece9be-d974-4a26-827f-26f4c029773a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:51.310188 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d0ece9be-d974-4a26-827f-26f4c029773a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:51.310617 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d0ece9be-d974-4a26-827f-26f4c029773a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:51.311071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d0ece9be-d974-4a26-827f-26f4c029773a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:51.311822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d0ece9be-d974-4a26-827f-26f4c029773a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:51.326912 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d0ece9be-d974-4a26-827f-26f4c029773a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:51.327373 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d0ece9be-d974-4a26-827f-26f4c029773a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:51.340640 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ce46cd13-3b06-4390-9536-c6a94b44e061 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:51.340640 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ce46cd13-3b06-4390-9536-c6a94b44e061 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:51.354161 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce46cd13-3b06-4390-9536-c6a94b44e061 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:51.354651 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce46cd13-3b06-4390-9536-c6a94b44e061 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:51.355260 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce46cd13-3b06-4390-9536-c6a94b44e061 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:51.356147 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce46cd13-3b06-4390-9536-c6a94b44e061 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:51.357087 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce46cd13-3b06-4390-9536-c6a94b44e061 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:51.360837 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce46cd13-3b06-4390-9536-c6a94b44e061 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:51.793520 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ce46cd13-3b06-4390-9536-c6a94b44e061 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:51.809751 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ce46cd13-3b06-4390-9536-c6a94b44e061 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.473734 Aug 24 16:44:51.816790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 41/88] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:51 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:51.831001 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-fd783679-7063-4101-9cce-82c3525e216a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:51.831845 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-fd783679-7063-4101-9cce-82c3525e216a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:51.843256 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd783679-7063-4101-9cce-82c3525e216a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:51.843256 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd783679-7063-4101-9cce-82c3525e216a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:51.843256 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd783679-7063-4101-9cce-82c3525e216a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:51.843256 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd783679-7063-4101-9cce-82c3525e216a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:51.846789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd783679-7063-4101-9cce-82c3525e216a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:51.846789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd783679-7063-4101-9cce-82c3525e216a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:52.034688 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d0ece9be-d974-4a26-827f-26f4c029773a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:52.048917 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d0ece9be-d974-4a26-827f-26f4c029773a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.756481 Aug 24 16:44:52.051957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 48/89] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:51 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:52.095459 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a3250c6b-9c99-4484-8ce1-94712005fcc7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:52.096423 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a3250c6b-9c99-4484-8ce1-94712005fcc7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:52.107108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3250c6b-9c99-4484-8ce1-94712005fcc7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:52.107609 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3250c6b-9c99-4484-8ce1-94712005fcc7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:52.108043 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3250c6b-9c99-4484-8ce1-94712005fcc7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:52.109816 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3250c6b-9c99-4484-8ce1-94712005fcc7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:52.110275 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3250c6b-9c99-4484-8ce1-94712005fcc7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:52.112385 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3250c6b-9c99-4484-8ce1-94712005fcc7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:52.544602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fd783679-7063-4101-9cce-82c3525e216a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:52.544602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-fd783679-7063-4101-9cce-82c3525e216a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.676482 Aug 24 16:44:52.544602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 42/90] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:51 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:52.546268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a3250c6b-9c99-4484-8ce1-94712005fcc7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:52.546268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a3250c6b-9c99-4484-8ce1-94712005fcc7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.421915 Aug 24 16:44:52.546268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 49/91] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:52 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:52.854709 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9a48bbb5-7554-4836-9479-bc9a4e0b377f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:52.859521 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9a48bbb5-7554-4836-9479-bc9a4e0b377f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:52.863158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=4 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:52.869721 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a48bbb5-7554-4836-9479-bc9a4e0b377f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:52.871164 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a48bbb5-7554-4836-9479-bc9a4e0b377f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:52.871722 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a48bbb5-7554-4836-9479-bc9a4e0b377f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:52.872593 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a48bbb5-7554-4836-9479-bc9a4e0b377f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:52.873160 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a48bbb5-7554-4836-9479-bc9a4e0b377f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:52.873693 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a48bbb5-7554-4836-9479-bc9a4e0b377f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:52.911274 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-ea4cd422-3c4a-4c6a-9d9c-0eeb5f952f8b req-3d9ac6c7-f40b-49a6-8613-0a7949dc8f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5069db3c-2e20-4acd-9be9-f0ffc80832e5", "tag": "2887267a-02c9-4065-8fb6-a79355822e82"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:52.933685 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ea4cd422-3c4a-4c6a-9d9c-0eeb5f952f8b req-3d9ac6c7-f40b-49a6-8613-0a7949dc8f26 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:52.934868 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ea4cd422-3c4a-4c6a-9d9c-0eeb5f952f8b req-3d9ac6c7-f40b-49a6-8613-0a7949dc8f26 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:52.937976 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ea4cd422-3c4a-4c6a-9d9c-0eeb5f952f8b req-3d9ac6c7-f40b-49a6-8613-0a7949dc8f26 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:52.953708 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-ea4cd422-3c4a-4c6a-9d9c-0eeb5f952f8b req-3d9ac6c7-f40b-49a6-8613-0a7949dc8f26 service nova] Creating event network-changed:2887267a-02c9-4065-8fb6-a79355822e82 for instance 5069db3c-2e20-4acd-9be9-f0ffc80832e5 on hv-cinder-73116 Aug 24 16:44:52.961184 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-ea4cd422-3c4a-4c6a-9d9c-0eeb5f952f8b req-3d9ac6c7-f40b-49a6-8613-0a7949dc8f26 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058161 Aug 24 16:44:52.963136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 50/92] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:44:53.083535 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7058cbe9-529b-4192-abb3-97a31cacd1b5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:53.091875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7058cbe9-529b-4192-abb3-97a31cacd1b5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:53.103826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7058cbe9-529b-4192-abb3-97a31cacd1b5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:53.118428 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7058cbe9-529b-4192-abb3-97a31cacd1b5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:53.119338 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7058cbe9-529b-4192-abb3-97a31cacd1b5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:53.120242 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7058cbe9-529b-4192-abb3-97a31cacd1b5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:53.120897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7058cbe9-529b-4192-abb3-97a31cacd1b5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:53.121830 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7058cbe9-529b-4192-abb3-97a31cacd1b5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:53.140216 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9a48bbb5-7554-4836-9479-bc9a4e0b377f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:53.150796 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9a48bbb5-7554-4836-9479-bc9a4e0b377f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.311336 Aug 24 16:44:53.151392 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 43/93] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:52 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:53.255977 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-0021a9d5-53d5-433d-8de2-e06bee700b58 req-dfdc406b-10d3-489d-b439-0df76f511f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfcc291-21b3-42f0-9398-eeebfa0e9af8", "tag": "ae79267d-50a6-401e-8b7e-65a6ed48fbc9"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:53.276486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-0021a9d5-53d5-433d-8de2-e06bee700b58 req-dfdc406b-10d3-489d-b439-0df76f511f1f service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:53.278663 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-0021a9d5-53d5-433d-8de2-e06bee700b58 req-dfdc406b-10d3-489d-b439-0df76f511f1f service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:53.279170 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-0021a9d5-53d5-433d-8de2-e06bee700b58 req-dfdc406b-10d3-489d-b439-0df76f511f1f service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:53.301805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-0021a9d5-53d5-433d-8de2-e06bee700b58 req-dfdc406b-10d3-489d-b439-0df76f511f1f service nova] Creating event network-changed:ae79267d-50a6-401e-8b7e-65a6ed48fbc9 for instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 on hv-cinder-73116 Aug 24 16:44:53.301805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-0021a9d5-53d5-433d-8de2-e06bee700b58 req-dfdc406b-10d3-489d-b439-0df76f511f1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048351 Aug 24 16:44:53.301805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 44/94] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:53.415371 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7058cbe9-529b-4192-abb3-97a31cacd1b5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:53.425900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7058cbe9-529b-4192-abb3-97a31cacd1b5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.359207 Aug 24 16:44:53.426590 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 51/95] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:53 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:53.530894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7ec7638f-c618-4571-9259-144054847faa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:53.531562 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7ec7638f-c618-4571-9259-144054847faa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:53.535200 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bc4aeb59-d59f-478d-adc5-f8de0c32c266 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:53.535812 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bc4aeb59-d59f-478d-adc5-f8de0c32c266 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:53.537895 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ec7638f-c618-4571-9259-144054847faa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:53.538374 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ec7638f-c618-4571-9259-144054847faa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:53.538920 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ec7638f-c618-4571-9259-144054847faa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:53.539619 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ec7638f-c618-4571-9259-144054847faa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:53.540068 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ec7638f-c618-4571-9259-144054847faa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:53.540525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ec7638f-c618-4571-9259-144054847faa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:53.542520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4aeb59-d59f-478d-adc5-f8de0c32c266 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:53.543003 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4aeb59-d59f-478d-adc5-f8de0c32c266 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:53.543427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4aeb59-d59f-478d-adc5-f8de0c32c266 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:53.544105 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4aeb59-d59f-478d-adc5-f8de0c32c266 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:53.544598 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4aeb59-d59f-478d-adc5-f8de0c32c266 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:53.545298 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4aeb59-d59f-478d-adc5-f8de0c32c266 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:53.761077 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7ec7638f-c618-4571-9259-144054847faa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:53.761539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bc4aeb59-d59f-478d-adc5-f8de0c32c266 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:53.768829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bc4aeb59-d59f-478d-adc5-f8de0c32c266 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.237684 Aug 24 16:44:53.769404 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 52/96] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:53 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:53.771325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7ec7638f-c618-4571-9259-144054847faa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.244641 Aug 24 16:44:53.785207 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 45/97] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:53 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:54.171100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-676ee860-b285-476c-a63c-ee582177b6cc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:54.171984 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-676ee860-b285-476c-a63c-ee582177b6cc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:54.178214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-676ee860-b285-476c-a63c-ee582177b6cc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:54.178696 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-676ee860-b285-476c-a63c-ee582177b6cc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:54.179549 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-676ee860-b285-476c-a63c-ee582177b6cc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:54.180452 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-676ee860-b285-476c-a63c-ee582177b6cc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:54.180907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-676ee860-b285-476c-a63c-ee582177b6cc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:54.181331 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-676ee860-b285-476c-a63c-ee582177b6cc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:54.358090 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-676ee860-b285-476c-a63c-ee582177b6cc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:54.367421 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-676ee860-b285-476c-a63c-ee582177b6cc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.199262 Aug 24 16:44:54.369160 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 53/98] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:54 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:54.446588 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-805dc283-31d8-4d40-8c0c-facb50e84657 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:54.447206 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-805dc283-31d8-4d40-8c0c-facb50e84657 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:54.459890 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-805dc283-31d8-4d40-8c0c-facb50e84657 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:54.460428 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-805dc283-31d8-4d40-8c0c-facb50e84657 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:54.461297 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-805dc283-31d8-4d40-8c0c-facb50e84657 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:54.462791 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-805dc283-31d8-4d40-8c0c-facb50e84657 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:54.463384 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-805dc283-31d8-4d40-8c0c-facb50e84657 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:54.463955 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-805dc283-31d8-4d40-8c0c-facb50e84657 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:54.687188 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-805dc283-31d8-4d40-8c0c-facb50e84657 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:54.697603 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-805dc283-31d8-4d40-8c0c-facb50e84657 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.255177 Aug 24 16:44:54.704373 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 46/99] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:54 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:54.792811 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2fb350e1-6b65-4f9f-b335-13b41ea6e428 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:54.794451 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2fb350e1-6b65-4f9f-b335-13b41ea6e428 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:54.802179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fb350e1-6b65-4f9f-b335-13b41ea6e428 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:54.813401 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fb350e1-6b65-4f9f-b335-13b41ea6e428 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:54.813401 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fb350e1-6b65-4f9f-b335-13b41ea6e428 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:54.813401 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fb350e1-6b65-4f9f-b335-13b41ea6e428 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:54.813401 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fb350e1-6b65-4f9f-b335-13b41ea6e428 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:54.813952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5c67e4f3-3ffd-4dcc-b223-d8032206d093 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:54.814369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fb350e1-6b65-4f9f-b335-13b41ea6e428 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:54.814447 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-5c67e4f3-3ffd-4dcc-b223-d8032206d093 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:54.814447 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c67e4f3-3ffd-4dcc-b223-d8032206d093 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:54.814447 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c67e4f3-3ffd-4dcc-b223-d8032206d093 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:54.814647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c67e4f3-3ffd-4dcc-b223-d8032206d093 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:54.815394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c67e4f3-3ffd-4dcc-b223-d8032206d093 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:54.816172 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c67e4f3-3ffd-4dcc-b223-d8032206d093 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:54.816647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c67e4f3-3ffd-4dcc-b223-d8032206d093 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:55.114492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2fb350e1-6b65-4f9f-b335-13b41ea6e428 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:55.127457 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2fb350e1-6b65-4f9f-b335-13b41ea6e428 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.334618 Aug 24 16:44:55.127457 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 54/100] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:54 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:55.127728 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5c67e4f3-3ffd-4dcc-b223-d8032206d093 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:55.135998 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5c67e4f3-3ffd-4dcc-b223-d8032206d093 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.342793 Aug 24 16:44:55.136633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 47/101] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:54 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:55.392074 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-37c1fa95-9021-4879-8599-24f51ba7bb14 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:55.392074 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-37c1fa95-9021-4879-8599-24f51ba7bb14 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:55.396982 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37c1fa95-9021-4879-8599-24f51ba7bb14 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:55.397467 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37c1fa95-9021-4879-8599-24f51ba7bb14 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:55.398005 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37c1fa95-9021-4879-8599-24f51ba7bb14 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:55.398967 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37c1fa95-9021-4879-8599-24f51ba7bb14 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:55.399421 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37c1fa95-9021-4879-8599-24f51ba7bb14 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:55.399841 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37c1fa95-9021-4879-8599-24f51ba7bb14 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:55.542101 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-37c1fa95-9021-4879-8599-24f51ba7bb14 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:55.550635 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-37c1fa95-9021-4879-8599-24f51ba7bb14 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.164497 Aug 24 16:44:55.551212 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 55/102] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:55 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:55.718938 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-09ecfa42-5bb4-4785-b7f4-e0310c169a27 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:55.720058 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-09ecfa42-5bb4-4785-b7f4-e0310c169a27 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:55.732361 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09ecfa42-5bb4-4785-b7f4-e0310c169a27 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:55.741281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09ecfa42-5bb4-4785-b7f4-e0310c169a27 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:55.741281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09ecfa42-5bb4-4785-b7f4-e0310c169a27 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:55.741281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09ecfa42-5bb4-4785-b7f4-e0310c169a27 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:55.741281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09ecfa42-5bb4-4785-b7f4-e0310c169a27 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:55.743349 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09ecfa42-5bb4-4785-b7f4-e0310c169a27 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:56.142580 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-09ecfa42-5bb4-4785-b7f4-e0310c169a27 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:56.144085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7e7baa25-31a9-47cd-8134-82039b66ebc3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:56.144898 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7e7baa25-31a9-47cd-8134-82039b66ebc3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:56.151659 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-09ecfa42-5bb4-4785-b7f4-e0310c169a27 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.436637 Aug 24 16:44:56.151962 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e7baa25-31a9-47cd-8134-82039b66ebc3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:56.152537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e7baa25-31a9-47cd-8134-82039b66ebc3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:56.153174 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e7baa25-31a9-47cd-8134-82039b66ebc3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:56.153720 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 48/103] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:55 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:56.154135 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e7baa25-31a9-47cd-8134-82039b66ebc3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:56.154698 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e7baa25-31a9-47cd-8134-82039b66ebc3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:56.155191 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e7baa25-31a9-47cd-8134-82039b66ebc3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:56.159525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-962a3a01-0c89-4e44-9b14-c9a0846979af tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:56.160436 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-962a3a01-0c89-4e44-9b14-c9a0846979af tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:56.167129 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-962a3a01-0c89-4e44-9b14-c9a0846979af tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:56.168161 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-962a3a01-0c89-4e44-9b14-c9a0846979af tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:56.169350 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-962a3a01-0c89-4e44-9b14-c9a0846979af tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:56.170621 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-962a3a01-0c89-4e44-9b14-c9a0846979af tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:56.171256 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-962a3a01-0c89-4e44-9b14-c9a0846979af tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:56.172009 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-962a3a01-0c89-4e44-9b14-c9a0846979af tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:56.458670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7e7baa25-31a9-47cd-8134-82039b66ebc3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:56.478057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7e7baa25-31a9-47cd-8134-82039b66ebc3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.337594 Aug 24 16:44:56.484216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 56/104] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:56 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:56.503312 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-962a3a01-0c89-4e44-9b14-c9a0846979af tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:56.512383 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-962a3a01-0c89-4e44-9b14-c9a0846979af tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.357169 Aug 24 16:44:56.529897 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 49/105] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:56 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:56.574112 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-10fe499a-8c87-412d-8c27-c7d7bb227126 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:56.575191 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-10fe499a-8c87-412d-8c27-c7d7bb227126 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:56.584735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10fe499a-8c87-412d-8c27-c7d7bb227126 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:56.589543 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10fe499a-8c87-412d-8c27-c7d7bb227126 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:56.590471 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10fe499a-8c87-412d-8c27-c7d7bb227126 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:56.592271 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10fe499a-8c87-412d-8c27-c7d7bb227126 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:56.604456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10fe499a-8c87-412d-8c27-c7d7bb227126 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:56.604456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10fe499a-8c87-412d-8c27-c7d7bb227126 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:56.786117 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-10fe499a-8c87-412d-8c27-c7d7bb227126 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:56.793469 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:56.796043 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-10fe499a-8c87-412d-8c27-c7d7bb227126 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.227855 Aug 24 16:44:56.797613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 57/106] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:56 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:57.173468 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1318b26d-8a4a-44da-8a83-76d219d30a53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:57.174084 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1318b26d-8a4a-44da-8a83-76d219d30a53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:57.191753 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1318b26d-8a4a-44da-8a83-76d219d30a53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.192245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1318b26d-8a4a-44da-8a83-76d219d30a53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.192701 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1318b26d-8a4a-44da-8a83-76d219d30a53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.193401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1318b26d-8a4a-44da-8a83-76d219d30a53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.193843 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1318b26d-8a4a-44da-8a83-76d219d30a53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.194430 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1318b26d-8a4a-44da-8a83-76d219d30a53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.456081 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1318b26d-8a4a-44da-8a83-76d219d30a53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:57.470522 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1318b26d-8a4a-44da-8a83-76d219d30a53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.299617 Aug 24 16:44:57.485049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 50/107] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:57 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:57.505679 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0f83740b-4356-411f-af79-1627ccdf90fb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:57.510799 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0f83740b-4356-411f-af79-1627ccdf90fb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:57.513749 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f83740b-4356-411f-af79-1627ccdf90fb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.514232 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f83740b-4356-411f-af79-1627ccdf90fb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.514826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f83740b-4356-411f-af79-1627ccdf90fb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.515799 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f83740b-4356-411f-af79-1627ccdf90fb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.516261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f83740b-4356-411f-af79-1627ccdf90fb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.516865 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f83740b-4356-411f-af79-1627ccdf90fb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.534859 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-71b1d964-67be-4983-8ca9-4f7f29b36ee2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:57.535831 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-71b1d964-67be-4983-8ca9-4f7f29b36ee2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:57.546895 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b1d964-67be-4983-8ca9-4f7f29b36ee2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.547390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b1d964-67be-4983-8ca9-4f7f29b36ee2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.547822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b1d964-67be-4983-8ca9-4f7f29b36ee2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.548600 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b1d964-67be-4983-8ca9-4f7f29b36ee2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.549053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b1d964-67be-4983-8ca9-4f7f29b36ee2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.549471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b1d964-67be-4983-8ca9-4f7f29b36ee2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.721159 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0f83740b-4356-411f-af79-1627ccdf90fb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:57.733596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0f83740b-4356-411f-af79-1627ccdf90fb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.231729 Aug 24 16:44:57.734710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 58/108] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:57 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:57.771620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-71b1d964-67be-4983-8ca9-4f7f29b36ee2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:57.781970 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-71b1d964-67be-4983-8ca9-4f7f29b36ee2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.251851 Aug 24 16:44:57.782554 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 51/109] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:57 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:57.816725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cc2f9ab7-6916-4068-9da0-4b619b7c5fdc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:57.817265 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cc2f9ab7-6916-4068-9da0-4b619b7c5fdc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:57.823995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2f9ab7-6916-4068-9da0-4b619b7c5fdc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.826675 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2f9ab7-6916-4068-9da0-4b619b7c5fdc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.826675 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2f9ab7-6916-4068-9da0-4b619b7c5fdc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.826675 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2f9ab7-6916-4068-9da0-4b619b7c5fdc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.826675 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2f9ab7-6916-4068-9da0-4b619b7c5fdc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.827077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2f9ab7-6916-4068-9da0-4b619b7c5fdc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.974583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cc2f9ab7-6916-4068-9da0-4b619b7c5fdc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:57.978389 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cc2f9ab7-6916-4068-9da0-4b619b7c5fdc tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.165787 Aug 24 16:44:57.979312 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 59/110] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:57 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:58.492781 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-cc7226ec-d4c9-4b53-9e0b-7a238140c73f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:58.493220 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-cc7226ec-d4c9-4b53-9e0b-7a238140c73f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:58.498823 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc7226ec-d4c9-4b53-9e0b-7a238140c73f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:58.499303 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc7226ec-d4c9-4b53-9e0b-7a238140c73f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:58.547330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc7226ec-d4c9-4b53-9e0b-7a238140c73f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:58.547330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc7226ec-d4c9-4b53-9e0b-7a238140c73f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:58.547330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc7226ec-d4c9-4b53-9e0b-7a238140c73f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:58.547330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc7226ec-d4c9-4b53-9e0b-7a238140c73f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:58.635043 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-cc7226ec-d4c9-4b53-9e0b-7a238140c73f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:58.642679 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-cc7226ec-d4c9-4b53-9e0b-7a238140c73f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.154302 Aug 24 16:44:58.643248 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 52/111] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:58 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:58.754463 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f383b8d1-edb4-4533-888c-68701b059f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:58.755239 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f383b8d1-edb4-4533-888c-68701b059f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:58.865489 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f383b8d1-edb4-4533-888c-68701b059f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:58.865489 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f383b8d1-edb4-4533-888c-68701b059f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:58.865489 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f383b8d1-edb4-4533-888c-68701b059f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:58.865489 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f383b8d1-edb4-4533-888c-68701b059f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:58.866650 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f383b8d1-edb4-4533-888c-68701b059f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:58.866650 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f383b8d1-edb4-4533-888c-68701b059f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:58.867730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-26136b26-1c9c-4932-a683-f8326fe7a488 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:58.867730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-26136b26-1c9c-4932-a683-f8326fe7a488 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:58.867730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-26136b26-1c9c-4932-a683-f8326fe7a488 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:58.867730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-26136b26-1c9c-4932-a683-f8326fe7a488 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:58.868032 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-26136b26-1c9c-4932-a683-f8326fe7a488 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:58.868032 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-26136b26-1c9c-4932-a683-f8326fe7a488 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:58.868032 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-26136b26-1c9c-4932-a683-f8326fe7a488 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:58.868032 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-26136b26-1c9c-4932-a683-f8326fe7a488 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:59.051237 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-26136b26-1c9c-4932-a683-f8326fe7a488 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:59.064669 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-26136b26-1c9c-4932-a683-f8326fe7a488 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.264290 Aug 24 16:44:59.065939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f383b8d1-edb4-4533-888c-68701b059f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:59.066126 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 53/112] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:58 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:59.072648 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f5855f33-7f8e-4428-b58e-ce2f926aa72f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:59.102766 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f5855f33-7f8e-4428-b58e-ce2f926aa72f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:59.103637 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f383b8d1-edb4-4533-888c-68701b059f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.325135 Aug 24 16:44:59.103637 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 60/113] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:58 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:59.103771 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f5855f33-7f8e-4428-b58e-ce2f926aa72f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:59.103771 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f5855f33-7f8e-4428-b58e-ce2f926aa72f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:59.103771 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f5855f33-7f8e-4428-b58e-ce2f926aa72f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:59.103771 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f5855f33-7f8e-4428-b58e-ce2f926aa72f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:59.104045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f5855f33-7f8e-4428-b58e-ce2f926aa72f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:59.104045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f5855f33-7f8e-4428-b58e-ce2f926aa72f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:59.292694 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f5855f33-7f8e-4428-b58e-ce2f926aa72f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:59.302784 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f5855f33-7f8e-4428-b58e-ce2f926aa72f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.235213 Aug 24 16:44:59.304981 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 54/114] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:59 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:59.662790 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-79c8bf77-b4d7-41f8-a4ac-41aa94c88e24 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:59.663904 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-79c8bf77-b4d7-41f8-a4ac-41aa94c88e24 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:59.669852 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79c8bf77-b4d7-41f8-a4ac-41aa94c88e24 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:59.670269 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79c8bf77-b4d7-41f8-a4ac-41aa94c88e24 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:59.670711 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79c8bf77-b4d7-41f8-a4ac-41aa94c88e24 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:59.671389 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79c8bf77-b4d7-41f8-a4ac-41aa94c88e24 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:59.671974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79c8bf77-b4d7-41f8-a4ac-41aa94c88e24 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:59.672311 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79c8bf77-b4d7-41f8-a4ac-41aa94c88e24 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:59.842848 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-79c8bf77-b4d7-41f8-a4ac-41aa94c88e24 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:59.853779 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-79c8bf77-b4d7-41f8-a4ac-41aa94c88e24 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.194477 Aug 24 16:44:59.874198 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 61/115] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:59 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:00.089135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-69cbc369-6508-41fb-9415-48f84c595bde tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:00.089135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-69cbc369-6508-41fb-9415-48f84c595bde tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:00.098737 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69cbc369-6508-41fb-9415-48f84c595bde tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:00.099314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69cbc369-6508-41fb-9415-48f84c595bde tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:00.099965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69cbc369-6508-41fb-9415-48f84c595bde tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:00.101127 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69cbc369-6508-41fb-9415-48f84c595bde tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:00.101882 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69cbc369-6508-41fb-9415-48f84c595bde tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:00.102534 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69cbc369-6508-41fb-9415-48f84c595bde tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:00.122655 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-54bc6fc7-ee3d-464e-8d02-fa4142c6c2b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:00.124027 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-54bc6fc7-ee3d-464e-8d02-fa4142c6c2b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:00.134505 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54bc6fc7-ee3d-464e-8d02-fa4142c6c2b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:00.137796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54bc6fc7-ee3d-464e-8d02-fa4142c6c2b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:00.138241 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54bc6fc7-ee3d-464e-8d02-fa4142c6c2b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:00.139014 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54bc6fc7-ee3d-464e-8d02-fa4142c6c2b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:00.139468 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54bc6fc7-ee3d-464e-8d02-fa4142c6c2b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:00.139892 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54bc6fc7-ee3d-464e-8d02-fa4142c6c2b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:00.344196 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-69cbc369-6508-41fb-9415-48f84c595bde tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:00.352806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-69cbc369-6508-41fb-9415-48f84c595bde tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.269442 Aug 24 16:45:00.353396 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 55/116] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:00 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:00.372238 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-4bd2be4b-3de7-48a3-8b21-9c882363acd7 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:00.373087 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-4bd2be4b-3de7-48a3-8b21-9c882363acd7 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:00.376973 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-54bc6fc7-ee3d-464e-8d02-fa4142c6c2b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:00.381768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4bd2be4b-3de7-48a3-8b21-9c882363acd7 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:00.382922 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4bd2be4b-3de7-48a3-8b21-9c882363acd7 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:00.383525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4bd2be4b-3de7-48a3-8b21-9c882363acd7 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:00.384431 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4bd2be4b-3de7-48a3-8b21-9c882363acd7 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:00.385033 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4bd2be4b-3de7-48a3-8b21-9c882363acd7 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:00.385625 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4bd2be4b-3de7-48a3-8b21-9c882363acd7 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:00.390485 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-54bc6fc7-ee3d-464e-8d02-fa4142c6c2b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.268621 Aug 24 16:45:00.391570 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 62/117] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:00 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:00.422128 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=100 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:00.567389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4bd2be4b-3de7-48a3-8b21-9c882363acd7 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:00.575822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-4bd2be4b-3de7-48a3-8b21-9c882363acd7 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.210376 Aug 24 16:45:00.576428 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 56/118] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:00 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:00.878836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-669f4d70-04d4-4aa3-b315-fe080d2aaa1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:00.887668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-669f4d70-04d4-4aa3-b315-fe080d2aaa1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:00.887668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:00.889706 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f4d70-04d4-4aa3-b315-fe080d2aaa1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:00.890210 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f4d70-04d4-4aa3-b315-fe080d2aaa1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:00.890653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f4d70-04d4-4aa3-b315-fe080d2aaa1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:00.891363 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f4d70-04d4-4aa3-b315-fe080d2aaa1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:00.891897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f4d70-04d4-4aa3-b315-fe080d2aaa1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:00.892323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f4d70-04d4-4aa3-b315-fe080d2aaa1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:01.060012 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-669f4d70-04d4-4aa3-b315-fe080d2aaa1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:01.070130 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-669f4d70-04d4-4aa3-b315-fe080d2aaa1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.196474 Aug 24 16:45:01.071126 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 63/119] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:00 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:01.375586 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c71a2ba6-2f49-4220-8012-af2806c57401 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:01.378971 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c71a2ba6-2f49-4220-8012-af2806c57401 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:01.388620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c71a2ba6-2f49-4220-8012-af2806c57401 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:01.389350 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c71a2ba6-2f49-4220-8012-af2806c57401 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:01.389948 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c71a2ba6-2f49-4220-8012-af2806c57401 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:01.392230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c71a2ba6-2f49-4220-8012-af2806c57401 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:01.393680 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c71a2ba6-2f49-4220-8012-af2806c57401 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:01.394706 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c71a2ba6-2f49-4220-8012-af2806c57401 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:01.413568 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-632f0ac8-d4f6-4765-851c-5f5ef3731196 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:01.415434 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-632f0ac8-d4f6-4765-851c-5f5ef3731196 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:01.428324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-632f0ac8-d4f6-4765-851c-5f5ef3731196 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:01.429632 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-632f0ac8-d4f6-4765-851c-5f5ef3731196 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:01.430125 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-632f0ac8-d4f6-4765-851c-5f5ef3731196 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:01.430831 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-632f0ac8-d4f6-4765-851c-5f5ef3731196 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:01.432958 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-632f0ac8-d4f6-4765-851c-5f5ef3731196 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:01.434196 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-632f0ac8-d4f6-4765-851c-5f5ef3731196 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:01.732735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-632f0ac8-d4f6-4765-851c-5f5ef3731196 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:01.742166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-632f0ac8-d4f6-4765-851c-5f5ef3731196 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.332407 Aug 24 16:45:01.747086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 64/120] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:01 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:01.750394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c71a2ba6-2f49-4220-8012-af2806c57401 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:01.758667 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6e48f871-1200-4295-b9d0-5883afb288c1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:01.758667 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6e48f871-1200-4295-b9d0-5883afb288c1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:01.762614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c71a2ba6-2f49-4220-8012-af2806c57401 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.392390 Aug 24 16:45:01.764594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 57/121] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:01 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:01.768267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e48f871-1200-4295-b9d0-5883afb288c1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:01.773837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e48f871-1200-4295-b9d0-5883afb288c1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:01.774469 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e48f871-1200-4295-b9d0-5883afb288c1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:01.775351 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e48f871-1200-4295-b9d0-5883afb288c1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:01.776411 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e48f871-1200-4295-b9d0-5883afb288c1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:01.778257 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e48f871-1200-4295-b9d0-5883afb288c1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:01.976885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6e48f871-1200-4295-b9d0-5883afb288c1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:01.989750 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6e48f871-1200-4295-b9d0-5883afb288c1 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.241197 Aug 24 16:45:01.990757 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 65/122] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:01 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:02.092554 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8c610feb-57cb-4402-8827-53977ad2cb33 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:02.093176 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8c610feb-57cb-4402-8827-53977ad2cb33 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:02.099241 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c610feb-57cb-4402-8827-53977ad2cb33 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:02.099734 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c610feb-57cb-4402-8827-53977ad2cb33 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:02.100169 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c610feb-57cb-4402-8827-53977ad2cb33 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:02.101650 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c610feb-57cb-4402-8827-53977ad2cb33 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:02.102278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c610feb-57cb-4402-8827-53977ad2cb33 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:02.102903 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c610feb-57cb-4402-8827-53977ad2cb33 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:02.263617 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8c610feb-57cb-4402-8827-53977ad2cb33 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:02.275697 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8c610feb-57cb-4402-8827-53977ad2cb33 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.186678 Aug 24 16:45:02.276278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 58/123] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:02 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:02.626014 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-99790be4-33de-4a81-a080-bdebc20ff239 req-f931b4a2-62a3-4ac5-b7f1-b3b98c8e9599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "571bde76-f97b-4358-be97-b61869ac0da5", "name": "network-vif-plugged", "status": "completed", "tag": "94b5e105-7d98-45d8-b2c9-df6e9dd14d9f"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:02.636664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-99790be4-33de-4a81-a080-bdebc20ff239 req-f931b4a2-62a3-4ac5-b7f1-b3b98c8e9599 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:02.637140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-99790be4-33de-4a81-a080-bdebc20ff239 req-f931b4a2-62a3-4ac5-b7f1-b3b98c8e9599 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:02.637569 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-99790be4-33de-4a81-a080-bdebc20ff239 req-f931b4a2-62a3-4ac5-b7f1-b3b98c8e9599 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:02.649067 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-99790be4-33de-4a81-a080-bdebc20ff239 req-f931b4a2-62a3-4ac5-b7f1-b3b98c8e9599 service nova] Creating event network-vif-plugged:94b5e105-7d98-45d8-b2c9-df6e9dd14d9f for instance 571bde76-f97b-4358-be97-b61869ac0da5 on hv-cinder-73116 Aug 24 16:45:02.654938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-99790be4-33de-4a81-a080-bdebc20ff239 req-f931b4a2-62a3-4ac5-b7f1-b3b98c8e9599 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179668 Aug 24 16:45:02.657013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 66/124] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:02.781206 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b6949e64-74ae-4479-8824-958fbbefb1f8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:02.781867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b6949e64-74ae-4479-8824-958fbbefb1f8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:02.787609 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6949e64-74ae-4479-8824-958fbbefb1f8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:02.788858 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6949e64-74ae-4479-8824-958fbbefb1f8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:02.789428 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6949e64-74ae-4479-8824-958fbbefb1f8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:02.790038 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6949e64-74ae-4479-8824-958fbbefb1f8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:02.790489 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6949e64-74ae-4479-8824-958fbbefb1f8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:02.790909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6949e64-74ae-4479-8824-958fbbefb1f8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:02.800685 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-99d3513f-52c9-45b9-ae69-e3306b630869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:02.801380 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-99d3513f-52c9-45b9-ae69-e3306b630869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:02.807905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99d3513f-52c9-45b9-ae69-e3306b630869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:02.813096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99d3513f-52c9-45b9-ae69-e3306b630869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:02.813096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99d3513f-52c9-45b9-ae69-e3306b630869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:02.813096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99d3513f-52c9-45b9-ae69-e3306b630869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:02.813096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99d3513f-52c9-45b9-ae69-e3306b630869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:02.813436 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99d3513f-52c9-45b9-ae69-e3306b630869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:03.118183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-99d3513f-52c9-45b9-ae69-e3306b630869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:03.138575 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-99d3513f-52c9-45b9-ae69-e3306b630869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.338119 Aug 24 16:45:03.138858 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b6949e64-74ae-4479-8824-958fbbefb1f8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:03.149656 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b6949e64-74ae-4479-8824-958fbbefb1f8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.369385 Aug 24 16:45:03.149870 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 67/125] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:02 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:03.163711 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 59/126] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:02 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:03.166160 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5235990f-6918-486c-b9d9-b549695f659b tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:03.168607 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5235990f-6918-486c-b9d9-b549695f659b tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:03.189457 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5235990f-6918-486c-b9d9-b549695f659b tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:03.189457 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5235990f-6918-486c-b9d9-b549695f659b tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:03.189457 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5235990f-6918-486c-b9d9-b549695f659b tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:03.195731 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5235990f-6918-486c-b9d9-b549695f659b tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:03.197671 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5235990f-6918-486c-b9d9-b549695f659b tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:03.202551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5235990f-6918-486c-b9d9-b549695f659b tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:03.297650 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-81c2ce85-481a-44ae-a39f-4f32fcd4600a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:03.298470 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-81c2ce85-481a-44ae-a39f-4f32fcd4600a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:03.307833 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-81c2ce85-481a-44ae-a39f-4f32fcd4600a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:03.307833 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-81c2ce85-481a-44ae-a39f-4f32fcd4600a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:03.307833 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-81c2ce85-481a-44ae-a39f-4f32fcd4600a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:03.308490 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-81c2ce85-481a-44ae-a39f-4f32fcd4600a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:03.309132 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-81c2ce85-481a-44ae-a39f-4f32fcd4600a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:03.309694 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-81c2ce85-481a-44ae-a39f-4f32fcd4600a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:03.532363 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5235990f-6918-486c-b9d9-b549695f659b tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:03.541492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5235990f-6918-486c-b9d9-b549695f659b tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.389987 Aug 24 16:45:03.561864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 68/127] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:03 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:03.570744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-81c2ce85-481a-44ae-a39f-4f32fcd4600a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:03.579508 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-81c2ce85-481a-44ae-a39f-4f32fcd4600a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.285750 Aug 24 16:45:03.580094 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 60/128] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:03 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:04.166245 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-db164723-cea1-4561-8260-8ed707d8c0d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:04.167537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-db164723-cea1-4561-8260-8ed707d8c0d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:04.167876 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-38f8940a-2af7-416f-95aa-24dbbc81fa5d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:04.168651 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-38f8940a-2af7-416f-95aa-24dbbc81fa5d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:04.176414 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38f8940a-2af7-416f-95aa-24dbbc81fa5d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:04.177590 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38f8940a-2af7-416f-95aa-24dbbc81fa5d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:04.179297 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38f8940a-2af7-416f-95aa-24dbbc81fa5d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:04.181298 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38f8940a-2af7-416f-95aa-24dbbc81fa5d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:04.181978 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38f8940a-2af7-416f-95aa-24dbbc81fa5d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:04.182660 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38f8940a-2af7-416f-95aa-24dbbc81fa5d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:04.186302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db164723-cea1-4561-8260-8ed707d8c0d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:04.189117 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db164723-cea1-4561-8260-8ed707d8c0d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:04.189898 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db164723-cea1-4561-8260-8ed707d8c0d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:04.192104 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db164723-cea1-4561-8260-8ed707d8c0d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:04.192751 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db164723-cea1-4561-8260-8ed707d8c0d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:04.193319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db164723-cea1-4561-8260-8ed707d8c0d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:04.431094 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-db164723-cea1-4561-8260-8ed707d8c0d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:04.434338 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-38f8940a-2af7-416f-95aa-24dbbc81fa5d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:04.442525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-38f8940a-2af7-416f-95aa-24dbbc81fa5d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.279345 Aug 24 16:45:04.444661 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 61/129] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:04 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:04.457144 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-db164723-cea1-4561-8260-8ed707d8c0d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.283313 Aug 24 16:45:04.458212 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 69/130] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:04 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:04.566512 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2b86e671-4f96-4c94-9a8d-103d2e2522cb tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:04.567226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2b86e671-4f96-4c94-9a8d-103d2e2522cb tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:04.577054 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b86e671-4f96-4c94-9a8d-103d2e2522cb tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:04.577456 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b86e671-4f96-4c94-9a8d-103d2e2522cb tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:04.577958 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b86e671-4f96-4c94-9a8d-103d2e2522cb tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:04.578651 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b86e671-4f96-4c94-9a8d-103d2e2522cb tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:04.579259 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b86e671-4f96-4c94-9a8d-103d2e2522cb tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:04.579678 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b86e671-4f96-4c94-9a8d-103d2e2522cb tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:04.603130 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a3d4e0da-34ab-4516-ab48-d7980fad0576 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:04.604025 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a3d4e0da-34ab-4516-ab48-d7980fad0576 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:04.612817 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3d4e0da-34ab-4516-ab48-d7980fad0576 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:04.614136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3d4e0da-34ab-4516-ab48-d7980fad0576 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:04.615017 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3d4e0da-34ab-4516-ab48-d7980fad0576 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:04.616728 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3d4e0da-34ab-4516-ab48-d7980fad0576 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:04.617896 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3d4e0da-34ab-4516-ab48-d7980fad0576 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:04.618464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3d4e0da-34ab-4516-ab48-d7980fad0576 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:04.769584 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2b86e671-4f96-4c94-9a8d-103d2e2522cb tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:04.779020 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2b86e671-4f96-4c94-9a8d-103d2e2522cb tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1314 microversion: 2.1 time: 0.216389 Aug 24 16:45:04.779602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 62/131] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:04 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:04.784140 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-a8378efa-6c2d-42f8-ab2a-dd4d33e20fe6 req-73ffa376-0af2-44b2-8285-0d1dc7c4cae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033273ba-5c67-47d7-8191-7aa0388f87dc", "name": "network-vif-plugged", "status": "completed", "tag": "08c8eeee-cfbe-4e3e-9514-c73d861d88db"}, {"server_uuid": "2c63f0ac-d4f8-499f-8901-53d4dbbc15ac", "name": "network-vif-plugged", "status": "completed", "tag": "fefa6a59-cba3-43bd-99e5-f25c064dc3ea"}, {"server_uuid": "5069db3c-2e20-4acd-9be9-f0ffc80832e5", "name": "network-vif-plugged", "status": "completed", "tag": "2887267a-02c9-4065-8fb6-a79355822e82"}, {"server_uuid": "fcfcc291-21b3-42f0-9398-eeebfa0e9af8", "name": "network-vif-plugged", "status": "completed", "tag": "ae79267d-50a6-401e-8b7e-65a6ed48fbc9"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:04.803000 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a3d4e0da-34ab-4516-ab48-d7980fad0576 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:04.812267 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-a8378efa-6c2d-42f8-ab2a-dd4d33e20fe6 req-73ffa376-0af2-44b2-8285-0d1dc7c4cae0 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:04.812267 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-a8378efa-6c2d-42f8-ab2a-dd4d33e20fe6 req-73ffa376-0af2-44b2-8285-0d1dc7c4cae0 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:04.812267 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-a8378efa-6c2d-42f8-ab2a-dd4d33e20fe6 req-73ffa376-0af2-44b2-8285-0d1dc7c4cae0 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:04.817365 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a3d4e0da-34ab-4516-ab48-d7980fad0576 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.220561 Aug 24 16:45:04.819629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 70/132] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:04 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:04.831189 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-a8378efa-6c2d-42f8-ab2a-dd4d33e20fe6 req-73ffa376-0af2-44b2-8285-0d1dc7c4cae0 service nova] Creating event network-vif-plugged:08c8eeee-cfbe-4e3e-9514-c73d861d88db for instance 033273ba-5c67-47d7-8191-7aa0388f87dc on hv-cinder-73116 Aug 24 16:45:04.831189 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-a8378efa-6c2d-42f8-ab2a-dd4d33e20fe6 req-73ffa376-0af2-44b2-8285-0d1dc7c4cae0 service nova] Creating event network-vif-plugged:fefa6a59-cba3-43bd-99e5-f25c064dc3ea for instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac on hv-cinder-73116 Aug 24 16:45:04.831189 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-a8378efa-6c2d-42f8-ab2a-dd4d33e20fe6 req-73ffa376-0af2-44b2-8285-0d1dc7c4cae0 service nova] Creating event network-vif-plugged:2887267a-02c9-4065-8fb6-a79355822e82 for instance 5069db3c-2e20-4acd-9be9-f0ffc80832e5 on hv-cinder-73116 Aug 24 16:45:04.831189 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-a8378efa-6c2d-42f8-ab2a-dd4d33e20fe6 req-73ffa376-0af2-44b2-8285-0d1dc7c4cae0 service nova] Creating event network-vif-plugged:ae79267d-50a6-401e-8b7e-65a6ed48fbc9 for instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 on hv-cinder-73116 Aug 24 16:45:04.843985 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-a8378efa-6c2d-42f8-ab2a-dd4d33e20fe6 req-73ffa376-0af2-44b2-8285-0d1dc7c4cae0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.063214 Aug 24 16:45:04.844742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 63/133] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:05.464398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-317873dd-6772-4677-9815-c04b548ca4f2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:05.465145 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-317873dd-6772-4677-9815-c04b548ca4f2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:05.476567 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-317873dd-6772-4677-9815-c04b548ca4f2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:05.477773 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-317873dd-6772-4677-9815-c04b548ca4f2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:05.478088 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-317873dd-6772-4677-9815-c04b548ca4f2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:05.479000 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-317873dd-6772-4677-9815-c04b548ca4f2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:05.479672 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-317873dd-6772-4677-9815-c04b548ca4f2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:05.480282 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-317873dd-6772-4677-9815-c04b548ca4f2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:05.497498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-64fae26c-9598-484c-a728-9c2788f0bf5e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:05.503550 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-64fae26c-9598-484c-a728-9c2788f0bf5e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:05.521110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-64fae26c-9598-484c-a728-9c2788f0bf5e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:05.523885 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-64fae26c-9598-484c-a728-9c2788f0bf5e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:05.523885 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-64fae26c-9598-484c-a728-9c2788f0bf5e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:05.523885 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-64fae26c-9598-484c-a728-9c2788f0bf5e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:05.524490 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-64fae26c-9598-484c-a728-9c2788f0bf5e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:05.525003 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-64fae26c-9598-484c-a728-9c2788f0bf5e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:05.854862 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-317873dd-6772-4677-9815-c04b548ca4f2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:05.863587 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-317873dd-6772-4677-9815-c04b548ca4f2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.404410 Aug 24 16:45:05.864755 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 71/134] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:05 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:05.869676 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a1c077d3-c271-4f21-90f2-15659cf55d9c tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:05.870574 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a1c077d3-c271-4f21-90f2-15659cf55d9c tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:05.883134 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1c077d3-c271-4f21-90f2-15659cf55d9c tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:05.883971 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1c077d3-c271-4f21-90f2-15659cf55d9c tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:05.885104 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1c077d3-c271-4f21-90f2-15659cf55d9c tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:05.885958 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1c077d3-c271-4f21-90f2-15659cf55d9c tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:05.886842 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1c077d3-c271-4f21-90f2-15659cf55d9c tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:05.887581 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1c077d3-c271-4f21-90f2-15659cf55d9c tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:05.896991 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-64fae26c-9598-484c-a728-9c2788f0bf5e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:05.909308 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-64fae26c-9598-484c-a728-9c2788f0bf5e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.431883 Aug 24 16:45:05.910446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 64/135] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:05 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:05.917995 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-74b03bcc-1620-477b-946a-8cf8217188cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:05.919853 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-74b03bcc-1620-477b-946a-8cf8217188cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:05.929169 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-74b03bcc-1620-477b-946a-8cf8217188cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:05.930093 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-74b03bcc-1620-477b-946a-8cf8217188cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:05.931721 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-74b03bcc-1620-477b-946a-8cf8217188cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:05.933281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-74b03bcc-1620-477b-946a-8cf8217188cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:05.934281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-74b03bcc-1620-477b-946a-8cf8217188cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:05.935069 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-74b03bcc-1620-477b-946a-8cf8217188cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:06.146484 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a1c077d3-c271-4f21-90f2-15659cf55d9c tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:06.159969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-74b03bcc-1620-477b-946a-8cf8217188cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:06.161536 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a1c077d3-c271-4f21-90f2-15659cf55d9c tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1501 microversion: 2.1 time: 0.294808 Aug 24 16:45:06.169911 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 72/136] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:05 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1501 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:06.170180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-74b03bcc-1620-477b-946a-8cf8217188cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.258046 Aug 24 16:45:06.170752 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 65/137] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:05 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:06.887778 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c72f0c51-5519-47a8-a7e8-df2104ebea87 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:06.888518 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c72f0c51-5519-47a8-a7e8-df2104ebea87 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:06.895842 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c72f0c51-5519-47a8-a7e8-df2104ebea87 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:06.896400 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c72f0c51-5519-47a8-a7e8-df2104ebea87 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:06.896829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c72f0c51-5519-47a8-a7e8-df2104ebea87 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:06.897521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c72f0c51-5519-47a8-a7e8-df2104ebea87 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:06.898012 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c72f0c51-5519-47a8-a7e8-df2104ebea87 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:06.899039 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c72f0c51-5519-47a8-a7e8-df2104ebea87 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:06.941298 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3673c330-bdd2-4533-a341-a6e867e2cdf4 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:06.942684 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3673c330-bdd2-4533-a341-a6e867e2cdf4 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:06.949803 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3673c330-bdd2-4533-a341-a6e867e2cdf4 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:06.950607 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3673c330-bdd2-4533-a341-a6e867e2cdf4 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:06.950736 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3673c330-bdd2-4533-a341-a6e867e2cdf4 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:06.951455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3673c330-bdd2-4533-a341-a6e867e2cdf4 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:06.951886 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3673c330-bdd2-4533-a341-a6e867e2cdf4 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:06.952461 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3673c330-bdd2-4533-a341-a6e867e2cdf4 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:07.103564 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c72f0c51-5519-47a8-a7e8-df2104ebea87 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:07.117073 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c72f0c51-5519-47a8-a7e8-df2104ebea87 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.232957 Aug 24 16:45:07.132228 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 73/138] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:06 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:07.133308 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3673c330-bdd2-4533-a341-a6e867e2cdf4 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:07.142045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3673c330-bdd2-4533-a341-a6e867e2cdf4 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.205676 Aug 24 16:45:07.142715 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 66/139] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:06 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:07.195137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-694f41b4-b4f1-4259-a5c6-542daabf2f1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:07.196492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-694f41b4-b4f1-4259-a5c6-542daabf2f1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:07.202435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f41b4-b4f1-4259-a5c6-542daabf2f1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:07.203123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f41b4-b4f1-4259-a5c6-542daabf2f1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:07.203770 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f41b4-b4f1-4259-a5c6-542daabf2f1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:07.204648 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f41b4-b4f1-4259-a5c6-542daabf2f1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:07.205101 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f41b4-b4f1-4259-a5c6-542daabf2f1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:07.205520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f41b4-b4f1-4259-a5c6-542daabf2f1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:07.555501 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-694f41b4-b4f1-4259-a5c6-542daabf2f1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:07.563354 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-694f41b4-b4f1-4259-a5c6-542daabf2f1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1322 microversion: 2.1 time: 0.372276 Aug 24 16:45:07.564194 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 74/140] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:07 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:08.011939 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-51e04e33-67b0-4a43-893d-1781de3b610f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f17b62f-c080-4dbb-81a2-949759847f40"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:08.015399 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-51e04e33-67b0-4a43-893d-1781de3b610f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:08.022709 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e04e33-67b0-4a43-893d-1781de3b610f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.023298 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e04e33-67b0-4a43-893d-1781de3b610f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.023805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e04e33-67b0-4a43-893d-1781de3b610f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.024608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e04e33-67b0-4a43-893d-1781de3b610f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.025066 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e04e33-67b0-4a43-893d-1781de3b610f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.025487 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e04e33-67b0-4a43-893d-1781de3b610f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.141204 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-23ece84f-b2c9-4ac4-a454-10c31a6bb47b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:08.141933 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-23ece84f-b2c9-4ac4-a454-10c31a6bb47b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:08.155497 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23ece84f-b2c9-4ac4-a454-10c31a6bb47b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.156137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23ece84f-b2c9-4ac4-a454-10c31a6bb47b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.158099 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23ece84f-b2c9-4ac4-a454-10c31a6bb47b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.159052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23ece84f-b2c9-4ac4-a454-10c31a6bb47b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.160398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23ece84f-b2c9-4ac4-a454-10c31a6bb47b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.162037 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23ece84f-b2c9-4ac4-a454-10c31a6bb47b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.171214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:08.393677 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-23ece84f-b2c9-4ac4-a454-10c31a6bb47b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:08.402370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-23ece84f-b2c9-4ac4-a454-10c31a6bb47b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1367 microversion: 2.1 time: 0.267825 Aug 24 16:45:08.402946 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 75/141] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:08 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:08.407351 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cff1567d-cd22-4ac4-b253-55d12d42e866 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:08.407951 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cff1567d-cd22-4ac4-b253-55d12d42e866 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:08.413783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cff1567d-cd22-4ac4-b253-55d12d42e866 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.414273 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cff1567d-cd22-4ac4-b253-55d12d42e866 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.414706 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cff1567d-cd22-4ac4-b253-55d12d42e866 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.415401 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cff1567d-cd22-4ac4-b253-55d12d42e866 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.415931 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cff1567d-cd22-4ac4-b253-55d12d42e866 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.416277 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cff1567d-cd22-4ac4-b253-55d12d42e866 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.568421 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cff1567d-cd22-4ac4-b253-55d12d42e866 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:08.577949 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cff1567d-cd22-4ac4-b253-55d12d42e866 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1363 microversion: 2.1 time: 0.174015 Aug 24 16:45:08.578579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 76/142] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:08 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:08.586643 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-35ddbcc3-e08b-4158-b6c7-51d59f86364f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:08.587400 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-35ddbcc3-e08b-4158-b6c7-51d59f86364f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:08.599640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35ddbcc3-e08b-4158-b6c7-51d59f86364f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.607199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35ddbcc3-e08b-4158-b6c7-51d59f86364f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.607199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35ddbcc3-e08b-4158-b6c7-51d59f86364f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.607199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35ddbcc3-e08b-4158-b6c7-51d59f86364f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.607199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35ddbcc3-e08b-4158-b6c7-51d59f86364f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.607571 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35ddbcc3-e08b-4158-b6c7-51d59f86364f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.746150 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-35ddbcc3-e08b-4158-b6c7-51d59f86364f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:08.758828 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-35ddbcc3-e08b-4158-b6c7-51d59f86364f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1517 microversion: 2.1 time: 0.178480 Aug 24 16:45:08.759404 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 77/143] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:08 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:08.779685 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ecd36692-81ce-4ff4-b667-37b3ac41d1db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:08.781962 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ecd36692-81ce-4ff4-b667-37b3ac41d1db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:08.787938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecd36692-81ce-4ff4-b667-37b3ac41d1db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.788740 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecd36692-81ce-4ff4-b667-37b3ac41d1db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.789176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecd36692-81ce-4ff4-b667-37b3ac41d1db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.789872 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecd36692-81ce-4ff4-b667-37b3ac41d1db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.790323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecd36692-81ce-4ff4-b667-37b3ac41d1db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.790743 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecd36692-81ce-4ff4-b667-37b3ac41d1db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.860171 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-ecd36692-81ce-4ff4-b667-37b3ac41d1db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lazy-loading 'flavor' on Instance uuid 5069db3c-2e20-4acd-9be9-f0ffc80832e5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:45:09.437218 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ecd36692-81ce-4ff4-b667-37b3ac41d1db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "POST /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5/action" status: 200 len: 32 microversion: 2.1 time: 0.661462 Aug 24 16:45:09.438054 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 78/144] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:45:08 2022] POST /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5/action => generated 32 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 16:45:09.443573 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-70b4702c-f467-498c-9efb-cb4e3d0d20b2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:09.444286 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-70b4702c-f467-498c-9efb-cb4e3d0d20b2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:09.451386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70b4702c-f467-498c-9efb-cb4e3d0d20b2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:09.451871 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70b4702c-f467-498c-9efb-cb4e3d0d20b2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:09.452303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70b4702c-f467-498c-9efb-cb4e3d0d20b2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:09.453093 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70b4702c-f467-498c-9efb-cb4e3d0d20b2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:09.453601 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70b4702c-f467-498c-9efb-cb4e3d0d20b2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:09.454025 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70b4702c-f467-498c-9efb-cb4e3d0d20b2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:09.662857 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-70b4702c-f467-498c-9efb-cb4e3d0d20b2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:09.672794 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-70b4702c-f467-498c-9efb-cb4e3d0d20b2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1557 microversion: 2.1 time: 0.233305 Aug 24 16:45:09.674627 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 79/145] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:09 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1557 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:09.694531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-861bb98e-9ad3-44f0-b794-82e6ef8ae65e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:09.695504 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-861bb98e-9ad3-44f0-b794-82e6ef8ae65e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:09.701872 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-861bb98e-9ad3-44f0-b794-82e6ef8ae65e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:09.702370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-861bb98e-9ad3-44f0-b794-82e6ef8ae65e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:09.702814 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-861bb98e-9ad3-44f0-b794-82e6ef8ae65e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:09.703603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-861bb98e-9ad3-44f0-b794-82e6ef8ae65e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:09.704056 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-861bb98e-9ad3-44f0-b794-82e6ef8ae65e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:09.704506 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-861bb98e-9ad3-44f0-b794-82e6ef8ae65e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:09.879748 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-861bb98e-9ad3-44f0-b794-82e6ef8ae65e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:09.888453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-861bb98e-9ad3-44f0-b794-82e6ef8ae65e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.212552 Aug 24 16:45:09.889049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 80/146] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:09 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:09.907732 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e691e7a5-1362-4c03-ac72-17d41363f627 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:09.908559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e691e7a5-1362-4c03-ac72-17d41363f627 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:09.914480 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e691e7a5-1362-4c03-ac72-17d41363f627 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:09.914958 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e691e7a5-1362-4c03-ac72-17d41363f627 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:09.915391 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e691e7a5-1362-4c03-ac72-17d41363f627 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:09.916072 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e691e7a5-1362-4c03-ac72-17d41363f627 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:09.916559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e691e7a5-1362-4c03-ac72-17d41363f627 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:09.916984 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e691e7a5-1362-4c03-ac72-17d41363f627 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:10.057649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e691e7a5-1362-4c03-ac72-17d41363f627 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:10.067704 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e691e7a5-1362-4c03-ac72-17d41363f627 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1549 microversion: 2.1 time: 0.163603 Aug 24 16:45:10.069817 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 81/147] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:09 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:10.074787 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2b368fc6-99e8-41b0-b61b-bbf831daee74 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:10.075412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2b368fc6-99e8-41b0-b61b-bbf831daee74 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:10.084255 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2b368fc6-99e8-41b0-b61b-bbf831daee74 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:10.084255 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2b368fc6-99e8-41b0-b61b-bbf831daee74 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:10.084255 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2b368fc6-99e8-41b0-b61b-bbf831daee74 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:10.084255 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2b368fc6-99e8-41b0-b61b-bbf831daee74 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:10.084964 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2b368fc6-99e8-41b0-b61b-bbf831daee74 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:10.084964 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2b368fc6-99e8-41b0-b61b-bbf831daee74 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:10.232079 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2b368fc6-99e8-41b0-b61b-bbf831daee74 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161059 Aug 24 16:45:10.232730 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 82/148] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 16:45:10 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:10.242726 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b9367533-b2b4-4ce1-b8fb-a0d767a55003 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:10.243230 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b9367533-b2b4-4ce1-b8fb-a0d767a55003 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:10.246517 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:10.261919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b9367533-b2b4-4ce1-b8fb-a0d767a55003 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:10.262573 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b9367533-b2b4-4ce1-b8fb-a0d767a55003 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:10.263144 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b9367533-b2b4-4ce1-b8fb-a0d767a55003 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:10.264003 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b9367533-b2b4-4ce1-b8fb-a0d767a55003 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:10.264619 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b9367533-b2b4-4ce1-b8fb-a0d767a55003 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:10.265259 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b9367533-b2b4-4ce1-b8fb-a0d767a55003 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:10.441238 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b9367533-b2b4-4ce1-b8fb-a0d767a55003 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.203626 Aug 24 16:45:10.446356 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 83/149] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 16:45:10 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:10.911830 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-16f41129-5eba-4c40-9040-bde59d829c02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:10.913661 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-16f41129-5eba-4c40-9040-bde59d829c02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:10.914074 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-51e04e33-67b0-4a43-893d-1781de3b610f tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "POST /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.907791 Aug 24 16:45:10.915265 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 67/150] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:45:08 2022] POST /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5/os-volume_attachments => generated 194 bytes in 2911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:45:10.942657 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16f41129-5eba-4c40-9040-bde59d829c02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:10.952480 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16f41129-5eba-4c40-9040-bde59d829c02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:10.953531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16f41129-5eba-4c40-9040-bde59d829c02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:10.954300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16f41129-5eba-4c40-9040-bde59d829c02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:10.954771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16f41129-5eba-4c40-9040-bde59d829c02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:10.960723 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16f41129-5eba-4c40-9040-bde59d829c02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:11.725704 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-16f41129-5eba-4c40-9040-bde59d829c02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:11.734740 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-16f41129-5eba-4c40-9040-bde59d829c02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.828117 Aug 24 16:45:11.735394 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 84/151] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:10 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:12.147966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-b395605e-36f4-441c-b86d-d23de204b3fc req-5966659d-94ef-4e6c-b5bd-3bdb4d754118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c63f0ac-d4f8-499f-8901-53d4dbbc15ac", "tag": "fefa6a59-cba3-43bd-99e5-f25c064dc3ea"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:12.167929 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b395605e-36f4-441c-b86d-d23de204b3fc req-5966659d-94ef-4e6c-b5bd-3bdb4d754118 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:12.168616 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b395605e-36f4-441c-b86d-d23de204b3fc req-5966659d-94ef-4e6c-b5bd-3bdb4d754118 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:12.170089 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b395605e-36f4-441c-b86d-d23de204b3fc req-5966659d-94ef-4e6c-b5bd-3bdb4d754118 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:12.219554 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-b395605e-36f4-441c-b86d-d23de204b3fc req-5966659d-94ef-4e6c-b5bd-3bdb4d754118 service nova] Creating event network-changed:fefa6a59-cba3-43bd-99e5-f25c064dc3ea for instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac on hv-cinder-73116 Aug 24 16:45:12.233646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-b395605e-36f4-441c-b86d-d23de204b3fc req-5966659d-94ef-4e6c-b5bd-3bdb4d754118 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090417 Aug 24 16:45:12.251917 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 68/152] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:12.755420 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-badedfcd-804b-480f-9c41-7eea291ce551 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:12.756923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-badedfcd-804b-480f-9c41-7eea291ce551 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:12.765398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-badedfcd-804b-480f-9c41-7eea291ce551 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:12.767175 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-badedfcd-804b-480f-9c41-7eea291ce551 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:12.768745 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-badedfcd-804b-480f-9c41-7eea291ce551 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:12.769826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-badedfcd-804b-480f-9c41-7eea291ce551 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:12.772810 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-badedfcd-804b-480f-9c41-7eea291ce551 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:12.773780 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-badedfcd-804b-480f-9c41-7eea291ce551 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:12.945997 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-ae54d7a2-71eb-42ae-92ef-2d260c612830 req-2a4d7476-0838-4ead-a3ea-f3d32fb85267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfcc291-21b3-42f0-9398-eeebfa0e9af8", "tag": "ae79267d-50a6-401e-8b7e-65a6ed48fbc9"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:12.960918 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-ae54d7a2-71eb-42ae-92ef-2d260c612830 req-2a4d7476-0838-4ead-a3ea-f3d32fb85267 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:12.961691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-ae54d7a2-71eb-42ae-92ef-2d260c612830 req-2a4d7476-0838-4ead-a3ea-f3d32fb85267 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:12.962347 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-ae54d7a2-71eb-42ae-92ef-2d260c612830 req-2a4d7476-0838-4ead-a3ea-f3d32fb85267 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:12.981664 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-ae54d7a2-71eb-42ae-92ef-2d260c612830 req-2a4d7476-0838-4ead-a3ea-f3d32fb85267 service nova] Creating event network-changed:ae79267d-50a6-401e-8b7e-65a6ed48fbc9 for instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 on hv-cinder-73116 Aug 24 16:45:12.989219 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-ae54d7a2-71eb-42ae-92ef-2d260c612830 req-2a4d7476-0838-4ead-a3ea-f3d32fb85267 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050473 Aug 24 16:45:12.991476 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 69/153] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:13.069252 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-badedfcd-804b-480f-9c41-7eea291ce551 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:13.098328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-badedfcd-804b-480f-9c41-7eea291ce551 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.347049 Aug 24 16:45:13.099281 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 85/154] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:12 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:14.123139 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-21890724-945b-4237-94a7-7763de83c42b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:14.124622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-21890724-945b-4237-94a7-7763de83c42b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:14.131533 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21890724-945b-4237-94a7-7763de83c42b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:14.132042 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21890724-945b-4237-94a7-7763de83c42b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:14.132481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21890724-945b-4237-94a7-7763de83c42b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:14.133193 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21890724-945b-4237-94a7-7763de83c42b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:14.133646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21890724-945b-4237-94a7-7763de83c42b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:14.134095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21890724-945b-4237-94a7-7763de83c42b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:14.355701 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-21890724-945b-4237-94a7-7763de83c42b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:14.363977 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-21890724-945b-4237-94a7-7763de83c42b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.246194 Aug 24 16:45:14.367077 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 70/155] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:14 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:15.391988 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cd6935e3-396e-4cd6-bd44-41ad34a44d67 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:15.392555 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cd6935e3-396e-4cd6-bd44-41ad34a44d67 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:15.399257 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd6935e3-396e-4cd6-bd44-41ad34a44d67 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:15.399755 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd6935e3-396e-4cd6-bd44-41ad34a44d67 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:15.400183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd6935e3-396e-4cd6-bd44-41ad34a44d67 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:15.400905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd6935e3-396e-4cd6-bd44-41ad34a44d67 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:15.401368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd6935e3-396e-4cd6-bd44-41ad34a44d67 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:15.401786 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd6935e3-396e-4cd6-bd44-41ad34a44d67 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:15.548090 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cd6935e3-396e-4cd6-bd44-41ad34a44d67 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:15.559243 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cd6935e3-396e-4cd6-bd44-41ad34a44d67 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.171018 Aug 24 16:45:15.573078 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 86/156] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:15 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:16.580858 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-295ccdf8-74f3-4dd1-a52c-465f1bd078a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:16.581454 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-295ccdf8-74f3-4dd1-a52c-465f1bd078a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:16.589595 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-295ccdf8-74f3-4dd1-a52c-465f1bd078a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:16.590088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-295ccdf8-74f3-4dd1-a52c-465f1bd078a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:16.590529 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-295ccdf8-74f3-4dd1-a52c-465f1bd078a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:16.591224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-295ccdf8-74f3-4dd1-a52c-465f1bd078a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:16.591682 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-295ccdf8-74f3-4dd1-a52c-465f1bd078a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:16.592106 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-295ccdf8-74f3-4dd1-a52c-465f1bd078a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:16.735945 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-295ccdf8-74f3-4dd1-a52c-465f1bd078a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:16.753712 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-295ccdf8-74f3-4dd1-a52c-465f1bd078a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.176485 Aug 24 16:45:16.767214 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 71/157] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:16 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:17.774659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e7c28a12-722c-4594-b2e1-70593b00dbd5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:17.775257 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e7c28a12-722c-4594-b2e1-70593b00dbd5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:17.781298 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7c28a12-722c-4594-b2e1-70593b00dbd5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:17.783554 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7c28a12-722c-4594-b2e1-70593b00dbd5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:17.783554 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7c28a12-722c-4594-b2e1-70593b00dbd5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:17.783554 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7c28a12-722c-4594-b2e1-70593b00dbd5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:17.783554 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7c28a12-722c-4594-b2e1-70593b00dbd5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:17.783938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7c28a12-722c-4594-b2e1-70593b00dbd5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:17.920158 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e7c28a12-722c-4594-b2e1-70593b00dbd5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:17.928594 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e7c28a12-722c-4594-b2e1-70593b00dbd5 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.158056 Aug 24 16:45:17.931777 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 87/158] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:17 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:18.958065 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1f417206-2ccd-4b34-89f2-b81c334bbde7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:18.958859 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1f417206-2ccd-4b34-89f2-b81c334bbde7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:18.961679 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=71 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:18.966442 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1f417206-2ccd-4b34-89f2-b81c334bbde7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:18.966920 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1f417206-2ccd-4b34-89f2-b81c334bbde7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:18.967344 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1f417206-2ccd-4b34-89f2-b81c334bbde7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:18.968026 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1f417206-2ccd-4b34-89f2-b81c334bbde7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:18.968509 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1f417206-2ccd-4b34-89f2-b81c334bbde7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:18.968921 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1f417206-2ccd-4b34-89f2-b81c334bbde7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:19.107759 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1f417206-2ccd-4b34-89f2-b81c334bbde7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:19.116892 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1f417206-2ccd-4b34-89f2-b81c334bbde7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.162695 Aug 24 16:45:19.117494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 72/159] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:18 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:20.138697 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-20f2316a-4dd9-4b11-ae65-409225204d58 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:20.139370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-20f2316a-4dd9-4b11-ae65-409225204d58 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:20.146467 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20f2316a-4dd9-4b11-ae65-409225204d58 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:20.146987 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20f2316a-4dd9-4b11-ae65-409225204d58 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:20.147411 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20f2316a-4dd9-4b11-ae65-409225204d58 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:20.148090 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20f2316a-4dd9-4b11-ae65-409225204d58 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:20.148574 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20f2316a-4dd9-4b11-ae65-409225204d58 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:20.149020 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20f2316a-4dd9-4b11-ae65-409225204d58 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:20.316420 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-20f2316a-4dd9-4b11-ae65-409225204d58 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:20.326631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-20f2316a-4dd9-4b11-ae65-409225204d58 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.191958 Aug 24 16:45:20.327215 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 88/160] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:20 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:21.355225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0a320476-ad5e-4c16-aec4-369112e03584 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:21.356097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0a320476-ad5e-4c16-aec4-369112e03584 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:21.371032 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a320476-ad5e-4c16-aec4-369112e03584 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:21.371510 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a320476-ad5e-4c16-aec4-369112e03584 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:21.371992 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a320476-ad5e-4c16-aec4-369112e03584 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:21.372718 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a320476-ad5e-4c16-aec4-369112e03584 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:21.373167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a320476-ad5e-4c16-aec4-369112e03584 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:21.373583 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a320476-ad5e-4c16-aec4-369112e03584 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:21.521239 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0a320476-ad5e-4c16-aec4-369112e03584 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:21.525449 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:21.530158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0a320476-ad5e-4c16-aec4-369112e03584 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.184649 Aug 24 16:45:21.530736 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 73/161] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:21 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:22.550945 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b1c25a37-fc33-413e-b11a-157fb080e95b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:22.551584 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b1c25a37-fc33-413e-b11a-157fb080e95b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:22.558129 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1c25a37-fc33-413e-b11a-157fb080e95b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:22.558663 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1c25a37-fc33-413e-b11a-157fb080e95b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:22.559091 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1c25a37-fc33-413e-b11a-157fb080e95b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:22.559770 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1c25a37-fc33-413e-b11a-157fb080e95b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:22.560210 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1c25a37-fc33-413e-b11a-157fb080e95b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:22.560649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1c25a37-fc33-413e-b11a-157fb080e95b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:22.703937 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b1c25a37-fc33-413e-b11a-157fb080e95b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:22.712186 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b1c25a37-fc33-413e-b11a-157fb080e95b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.165112 Aug 24 16:45:22.712808 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 89/162] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:22 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:23.282548 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a858ba0c-7824-4cc4-8487-0049272a8394 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:23.283124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a858ba0c-7824-4cc4-8487-0049272a8394 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:23.291038 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a858ba0c-7824-4cc4-8487-0049272a8394 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:23.291510 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a858ba0c-7824-4cc4-8487-0049272a8394 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:23.291935 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a858ba0c-7824-4cc4-8487-0049272a8394 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:23.292708 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a858ba0c-7824-4cc4-8487-0049272a8394 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:23.293153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a858ba0c-7824-4cc4-8487-0049272a8394 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:23.293567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a858ba0c-7824-4cc4-8487-0049272a8394 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:23.320269 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a858ba0c-7824-4cc4-8487-0049272a8394 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Going to try to terminate instance {{(pid=127626) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:45:23.730727 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a858ba0c-7824-4cc4-8487-0049272a8394 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "DELETE /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 204 len: 0 microversion: 2.1 time: 0.451113 Aug 24 16:45:23.732760 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 74/163] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:45:23 2022] DELETE /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:45:23.741565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-32d88699-e4c8-46f0-8acb-8db8251a20e6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:23.742475 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f0f98711-346c-4cf9-9a03-9fb3de65ef63 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:23.742680 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-32d88699-e4c8-46f0-8acb-8db8251a20e6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:23.743601 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f0f98711-346c-4cf9-9a03-9fb3de65ef63 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:23.750154 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32d88699-e4c8-46f0-8acb-8db8251a20e6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:23.750710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32d88699-e4c8-46f0-8acb-8db8251a20e6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:23.751013 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0f98711-346c-4cf9-9a03-9fb3de65ef63 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:23.751127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32d88699-e4c8-46f0-8acb-8db8251a20e6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:23.751560 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0f98711-346c-4cf9-9a03-9fb3de65ef63 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:23.751846 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32d88699-e4c8-46f0-8acb-8db8251a20e6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:23.751935 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0f98711-346c-4cf9-9a03-9fb3de65ef63 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:23.752299 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32d88699-e4c8-46f0-8acb-8db8251a20e6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:23.752612 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0f98711-346c-4cf9-9a03-9fb3de65ef63 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:23.752741 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32d88699-e4c8-46f0-8acb-8db8251a20e6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:23.753062 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0f98711-346c-4cf9-9a03-9fb3de65ef63 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:23.753480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0f98711-346c-4cf9-9a03-9fb3de65ef63 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:23.772476 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:24.033637 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-32d88699-e4c8-46f0-8acb-8db8251a20e6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:24.042808 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-32d88699-e4c8-46f0-8acb-8db8251a20e6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.308794 Aug 24 16:45:24.043918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 90/164] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:23 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:24.046750 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f0f98711-346c-4cf9-9a03-9fb3de65ef63 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:24.059229 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f0f98711-346c-4cf9-9a03-9fb3de65ef63 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1553 microversion: 2.1 time: 0.322345 Aug 24 16:45:24.060501 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 75/165] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:23 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1553 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:25.071315 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e491dc13-1e31-435d-a580-82c64468f5cc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:25.071918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e491dc13-1e31-435d-a580-82c64468f5cc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:25.078407 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e491dc13-1e31-435d-a580-82c64468f5cc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:25.078889 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e491dc13-1e31-435d-a580-82c64468f5cc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:25.079316 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e491dc13-1e31-435d-a580-82c64468f5cc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:25.080071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e491dc13-1e31-435d-a580-82c64468f5cc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:25.080549 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e491dc13-1e31-435d-a580-82c64468f5cc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:25.080780 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-40cdc100-871b-42e3-a1c9-976ed8026d19 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:25.081219 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e491dc13-1e31-435d-a580-82c64468f5cc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:25.081396 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-40cdc100-871b-42e3-a1c9-976ed8026d19 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:25.087734 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40cdc100-871b-42e3-a1c9-976ed8026d19 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:25.088232 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40cdc100-871b-42e3-a1c9-976ed8026d19 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:25.088707 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40cdc100-871b-42e3-a1c9-976ed8026d19 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:25.089450 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40cdc100-871b-42e3-a1c9-976ed8026d19 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:25.089899 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40cdc100-871b-42e3-a1c9-976ed8026d19 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:25.090322 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40cdc100-871b-42e3-a1c9-976ed8026d19 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:25.277607 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-40cdc100-871b-42e3-a1c9-976ed8026d19 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:25.290139 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e491dc13-1e31-435d-a580-82c64468f5cc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:25.290533 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-40cdc100-871b-42e3-a1c9-976ed8026d19 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1553 microversion: 2.1 time: 0.213472 Aug 24 16:45:25.291131 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 76/166] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:25 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1553 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:25.298022 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e491dc13-1e31-435d-a580-82c64468f5cc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.232637 Aug 24 16:45:25.298577 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 91/167] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:25 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:26.312872 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8d9ccdad-1e5a-4c33-9640-c19d9f50664a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:26.314445 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8d9ccdad-1e5a-4c33-9640-c19d9f50664a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:26.324198 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4892caea-21cc-49b0-9051-6e6b2210f0df tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:26.324198 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4892caea-21cc-49b0-9051-6e6b2210f0df tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:26.326391 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4892caea-21cc-49b0-9051-6e6b2210f0df tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:26.326871 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4892caea-21cc-49b0-9051-6e6b2210f0df tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:26.327299 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4892caea-21cc-49b0-9051-6e6b2210f0df tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:26.327984 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4892caea-21cc-49b0-9051-6e6b2210f0df tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:26.328458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4892caea-21cc-49b0-9051-6e6b2210f0df tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:26.328876 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4892caea-21cc-49b0-9051-6e6b2210f0df tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:26.334320 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8d9ccdad-1e5a-4c33-9640-c19d9f50664a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:26.334906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8d9ccdad-1e5a-4c33-9640-c19d9f50664a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:26.335514 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8d9ccdad-1e5a-4c33-9640-c19d9f50664a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:26.336402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8d9ccdad-1e5a-4c33-9640-c19d9f50664a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:26.336997 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8d9ccdad-1e5a-4c33-9640-c19d9f50664a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:26.337528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8d9ccdad-1e5a-4c33-9640-c19d9f50664a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:26.617920 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4892caea-21cc-49b0-9051-6e6b2210f0df tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:26.627377 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8d9ccdad-1e5a-4c33-9640-c19d9f50664a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:26.627635 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4892caea-21cc-49b0-9051-6e6b2210f0df tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.312144 Aug 24 16:45:26.628226 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 92/168] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:26 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:26.639681 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8d9ccdad-1e5a-4c33-9640-c19d9f50664a tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1553 microversion: 2.1 time: 0.331144 Aug 24 16:45:26.652171 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 77/169] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:26 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1553 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:26.834499 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-954c6465-e93a-4a96-bb6e-dcd8757f4ab8 req-1c486171-7d81-4f9a-bb96-7573e830f8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "571bde76-f97b-4358-be97-b61869ac0da5", "name": "network-vif-deleted", "tag": "94b5e105-7d98-45d8-b2c9-df6e9dd14d9f"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:26.844132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-954c6465-e93a-4a96-bb6e-dcd8757f4ab8 req-1c486171-7d81-4f9a-bb96-7573e830f8d3 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:26.844640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-954c6465-e93a-4a96-bb6e-dcd8757f4ab8 req-1c486171-7d81-4f9a-bb96-7573e830f8d3 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:26.845422 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-954c6465-e93a-4a96-bb6e-dcd8757f4ab8 req-1c486171-7d81-4f9a-bb96-7573e830f8d3 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:26.860943 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-954c6465-e93a-4a96-bb6e-dcd8757f4ab8 req-1c486171-7d81-4f9a-bb96-7573e830f8d3 service nova] Creating event network-vif-deleted:94b5e105-7d98-45d8-b2c9-df6e9dd14d9f for instance 571bde76-f97b-4358-be97-b61869ac0da5 on hv-cinder-73116 Aug 24 16:45:26.866297 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-954c6465-e93a-4a96-bb6e-dcd8757f4ab8 req-1c486171-7d81-4f9a-bb96-7573e830f8d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036060 Aug 24 16:45:26.866829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 93/170] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:27.649768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1b665332-63e6-48c5-8b3d-2ba35d3ef9ab tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:27.650384 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1b665332-63e6-48c5-8b3d-2ba35d3ef9ab tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:27.656813 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1b665332-63e6-48c5-8b3d-2ba35d3ef9ab tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:27.657347 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1b665332-63e6-48c5-8b3d-2ba35d3ef9ab tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:27.657780 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1b665332-63e6-48c5-8b3d-2ba35d3ef9ab tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:27.658481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1b665332-63e6-48c5-8b3d-2ba35d3ef9ab tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:27.658929 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1b665332-63e6-48c5-8b3d-2ba35d3ef9ab tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:27.659549 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1b665332-63e6-48c5-8b3d-2ba35d3ef9ab tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:27.663919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:27.667192 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:27.671046 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:27.671527 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:27.671948 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:27.672682 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:27.673129 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:27.673540 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:27.706084 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:27.706553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:27.706972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:27.707909 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lazy-loading 'fault' on Instance uuid 571bde76-f97b-4358-be97-b61869ac0da5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:45:27.775548 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491e2b9a44bd47b190b1a0b1250bf1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09164dc6ad44a87b7fae777d9f8435a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:27.790938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e666a82e-a622-478a-b4d2-3b13052a5732 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 200 len: 1350 microversion: 2.1 time: 0.132202 Aug 24 16:45:27.791571 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 94/171] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:27 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 1350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:27.847566 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1b665332-63e6-48c5-8b3d-2ba35d3ef9ab tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:27.856764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1b665332-63e6-48c5-8b3d-2ba35d3ef9ab tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.211322 Aug 24 16:45:27.857488 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 78/172] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:27 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:28.815449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:28.816067 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:28.822277 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.822761 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.823191 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.823881 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.824329 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.824767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.841175 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] HTTP exception thrown: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Request method failure captured: Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 HTTP/1.1 Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVlpid4KknMvRHddSdqdPkl17dT_xx4_YSquom3TL876tRlJCOXAwdMEBpRsKhtKdU-5yQMjdOALAH_qx9xOCdRSEwFVBRGhL5QzblFZt-Qht7sEgTp9Fs2h9YLoitEe3tt_KDgiBuroc9IE214LTvd1J_8aRtcl9cqiZuiC966890 Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: d09164dc6ad44a87b7fae777d9f8435a Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:45:28.846333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d09164dc6ad44a87b7fae777d9f8435a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: d09164dc6ad44a87b7fae777d9f8435a Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-DeleteServersTestJSON-1349982945-project Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 491e2b9a44bd47b190b1a0b1250bf1f3 Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-DeleteServersTestJSON-1349982945-project Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:28.849182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '571bde76-f97b-4358-be97-b61869ac0da5'} Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:45:28.854060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:28.855514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:28.856861 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Returning 404 to user: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:45:28.856861 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c66f583c-ffa7-4870-8384-75afbf735760 tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 404 len: 111 microversion: 2.1 time: 0.036713 Aug 24 16:45:28.856861 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 95/173] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:28 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:45:28.879132 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2d454f20-4471-4721-8b04-75fe0b898f04 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:28.880698 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2d454f20-4471-4721-8b04-75fe0b898f04 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:28.897708 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d454f20-4471-4721-8b04-75fe0b898f04 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.898512 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d454f20-4471-4721-8b04-75fe0b898f04 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.898954 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d454f20-4471-4721-8b04-75fe0b898f04 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.899668 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d454f20-4471-4721-8b04-75fe0b898f04 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.900123 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d454f20-4471-4721-8b04-75fe0b898f04 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.900576 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d454f20-4471-4721-8b04-75fe0b898f04 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.977986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:28.980176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:28.986392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.986867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.987285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.988070 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.988546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.989149 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:29.002836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] HTTP exception thrown: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Request method failure captured: Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5/os-volume_attachments HTTP/1.1 Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVlpid4KknMvRHddSdqdPkl17dT_xx4_YSquom3TL876tRlJCOXAwdMEBpRsKhtKdU-5yQMjdOALAH_qx9xOCdRSEwFVBRGhL5QzblFZt-Qht7sEgTp9Fs2h9YLoitEe3tt_KDgiBuroc9IE214LTvd1J_8aRtcl9cqiZuiC966890 Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: d09164dc6ad44a87b7fae777d9f8435a Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:45:29.006308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d09164dc6ad44a87b7fae777d9f8435a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: d09164dc6ad44a87b7fae777d9f8435a Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-DeleteServersTestJSON-1349982945-project Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 491e2b9a44bd47b190b1a0b1250bf1f3 Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-DeleteServersTestJSON-1349982945-project Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:29.010670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'server_id': '571bde76-f97b-4358-be97-b61869ac0da5'} Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:45:29.011323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:29.012357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:29.013628 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Returning 404 to user: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:45:29.013628 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-36e5b5ee-9a04-4c4d-8ec8-03eeed247b2d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033471 Aug 24 16:45:29.013628 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 96/174] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:45:28 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:45:29.056838 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2d454f20-4471-4721-8b04-75fe0b898f04 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:29.064970 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2d454f20-4471-4721-8b04-75fe0b898f04 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.189685 Aug 24 16:45:29.065616 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 79/175] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:28 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:30.087611 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b0f7e598-5337-4ef4-98ce-e8bf3a86b163 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:30.088256 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b0f7e598-5337-4ef4-98ce-e8bf3a86b163 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:30.094217 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0f7e598-5337-4ef4-98ce-e8bf3a86b163 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:30.094693 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0f7e598-5337-4ef4-98ce-e8bf3a86b163 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:30.095118 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0f7e598-5337-4ef4-98ce-e8bf3a86b163 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:30.095790 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0f7e598-5337-4ef4-98ce-e8bf3a86b163 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:30.096232 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0f7e598-5337-4ef4-98ce-e8bf3a86b163 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:30.096678 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0f7e598-5337-4ef4-98ce-e8bf3a86b163 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:30.236776 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b0f7e598-5337-4ef4-98ce-e8bf3a86b163 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:30.245519 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b0f7e598-5337-4ef4-98ce-e8bf3a86b163 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.162207 Aug 24 16:45:30.246092 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 97/176] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:30 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:30.391820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:30.392329 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:30.399845 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:30.400350 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:30.400811 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:30.401504 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:30.401960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:30.402390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:30.416845 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] HTTP exception thrown: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Request method failure captured: Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: DELETE /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 HTTP/1.1 Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVlpid4KknMvRHddSdqdPkl17dT_xx4_YSquom3TL876tRlJCOXAwdMEBpRsKhtKdU-5yQMjdOALAH_qx9xOCdRSEwFVBRGhL5QzblFZt-Qht7sEgTp9Fs2h9YLoitEe3tt_KDgiBuroc9IE214LTvd1J_8aRtcl9cqiZuiC966890 Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: d09164dc6ad44a87b7fae777d9f8435a Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:45:30.421544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d09164dc6ad44a87b7fae777d9f8435a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: d09164dc6ad44a87b7fae777d9f8435a Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-DeleteServersTestJSON-1349982945-project Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 491e2b9a44bd47b190b1a0b1250bf1f3 Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-DeleteServersTestJSON-1349982945-project Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:30.427224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '571bde76-f97b-4358-be97-b61869ac0da5'} Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:45:30.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:30.428960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:45:30.429967 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Returning 404 to user: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:45:30.429967 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-de21f374-930a-4e3d-981d-0d581f13744d tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "DELETE /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 404 len: 111 microversion: 2.1 time: 0.034990 Aug 24 16:45:30.429967 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 80/177] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:45:30 2022] DELETE /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:45:30.433095 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:30.433708 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] [instance: 571bde76-f97b-4358-be97-b61869ac0da5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:30.440302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:30.443503 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:30.443503 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:30.443503 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:30.443503 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:30.443862 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:30.457165 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] HTTP exception thrown: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Request method failure captured: Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 HTTP/1.1 Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVlpid4KknMvRHddSdqdPkl17dT_xx4_YSquom3TL876tRlJCOXAwdMEBpRsKhtKdU-5yQMjdOALAH_qx9xOCdRSEwFVBRGhL5QzblFZt-Qht7sEgTp9Fs2h9YLoitEe3tt_KDgiBuroc9IE214LTvd1J_8aRtcl9cqiZuiC966890 Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: d09164dc6ad44a87b7fae777d9f8435a Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:45:30.459666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d09164dc6ad44a87b7fae777d9f8435a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d09164dc6ad44a87b7fae777d9f8435a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: d09164dc6ad44a87b7fae777d9f8435a Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-DeleteServersTestJSON-1349982945 Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-DeleteServersTestJSON-1349982945-project Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 491e2b9a44bd47b190b1a0b1250bf1f3 Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-DeleteServersTestJSON-1349982945-project Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:30.460972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '571bde76-f97b-4358-be97-b61869ac0da5'} Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:45:30.461621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. Aug 24 16:45:30.462771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:45:30.463890 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] Returning 404 to user: Instance 571bde76-f97b-4358-be97-b61869ac0da5 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:45:30.463890 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9b1d7ddf-3826-4ae5-ba46-760d2204e16e tempest-DeleteServersTestJSON-1349982945 tempest-DeleteServersTestJSON-1349982945-project] 10.222.0.17 "GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5" status: 404 len: 111 microversion: 2.1 time: 0.031862 Aug 24 16:45:30.463890 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 98/178] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:30 2022] GET /compute/v2.1/servers/571bde76-f97b-4358-be97-b61869ac0da5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:45:31.267240 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b357ba0d-d041-4eb1-9d37-e9550da2ce01 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:31.267865 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b357ba0d-d041-4eb1-9d37-e9550da2ce01 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:31.274896 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b357ba0d-d041-4eb1-9d37-e9550da2ce01 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:31.275386 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b357ba0d-d041-4eb1-9d37-e9550da2ce01 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:31.275825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b357ba0d-d041-4eb1-9d37-e9550da2ce01 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:31.276557 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b357ba0d-d041-4eb1-9d37-e9550da2ce01 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:31.277014 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b357ba0d-d041-4eb1-9d37-e9550da2ce01 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:31.277439 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b357ba0d-d041-4eb1-9d37-e9550da2ce01 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:31.530447 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b357ba0d-d041-4eb1-9d37-e9550da2ce01 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:31.534284 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b357ba0d-d041-4eb1-9d37-e9550da2ce01 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.270832 Aug 24 16:45:31.534877 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 81/179] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:31 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:32.556604 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2972859a-3873-4e97-947b-5363c4b56784 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:32.557814 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2972859a-3873-4e97-947b-5363c4b56784 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:32.567681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2972859a-3873-4e97-947b-5363c4b56784 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:32.567681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2972859a-3873-4e97-947b-5363c4b56784 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:32.567681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2972859a-3873-4e97-947b-5363c4b56784 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:32.567681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2972859a-3873-4e97-947b-5363c4b56784 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:32.568241 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2972859a-3873-4e97-947b-5363c4b56784 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:32.568241 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2972859a-3873-4e97-947b-5363c4b56784 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:32.757470 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2972859a-3873-4e97-947b-5363c4b56784 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:32.770876 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2972859a-3873-4e97-947b-5363c4b56784 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.219240 Aug 24 16:45:32.772317 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 99/180] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:32 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:33.791586 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1d2ac3d9-5a85-44df-b060-25d471282b60 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:33.792804 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1d2ac3d9-5a85-44df-b060-25d471282b60 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:33.799809 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1d2ac3d9-5a85-44df-b060-25d471282b60 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:33.800460 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1d2ac3d9-5a85-44df-b060-25d471282b60 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:33.801909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1d2ac3d9-5a85-44df-b060-25d471282b60 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:33.802825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1d2ac3d9-5a85-44df-b060-25d471282b60 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:33.803275 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1d2ac3d9-5a85-44df-b060-25d471282b60 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:33.803887 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1d2ac3d9-5a85-44df-b060-25d471282b60 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:33.998916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1d2ac3d9-5a85-44df-b060-25d471282b60 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:34.007614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1d2ac3d9-5a85-44df-b060-25d471282b60 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.219682 Aug 24 16:45:34.008387 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 82/181] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:33 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:35.029034 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0370af3f-9277-45b9-a71f-5c358ba015cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:35.030326 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0370af3f-9277-45b9-a71f-5c358ba015cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:35.036774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0370af3f-9277-45b9-a71f-5c358ba015cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:35.037291 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0370af3f-9277-45b9-a71f-5c358ba015cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:35.037716 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0370af3f-9277-45b9-a71f-5c358ba015cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:35.038394 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0370af3f-9277-45b9-a71f-5c358ba015cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:35.038846 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0370af3f-9277-45b9-a71f-5c358ba015cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:35.039254 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0370af3f-9277-45b9-a71f-5c358ba015cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:35.181061 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0370af3f-9277-45b9-a71f-5c358ba015cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:35.189093 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0370af3f-9277-45b9-a71f-5c358ba015cb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.163790 Aug 24 16:45:35.189797 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 100/182] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:35 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:36.213292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-08ebf6a1-b14c-4b48-856e-eea765e2cb57 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:36.213971 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-08ebf6a1-b14c-4b48-856e-eea765e2cb57 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:36.220366 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-08ebf6a1-b14c-4b48-856e-eea765e2cb57 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:36.220897 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-08ebf6a1-b14c-4b48-856e-eea765e2cb57 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:36.221342 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-08ebf6a1-b14c-4b48-856e-eea765e2cb57 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:36.222023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-08ebf6a1-b14c-4b48-856e-eea765e2cb57 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:36.222988 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-08ebf6a1-b14c-4b48-856e-eea765e2cb57 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:36.223940 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-08ebf6a1-b14c-4b48-856e-eea765e2cb57 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:36.362096 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-08ebf6a1-b14c-4b48-856e-eea765e2cb57 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:36.378338 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-08ebf6a1-b14c-4b48-856e-eea765e2cb57 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.170467 Aug 24 16:45:36.379404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 83/183] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:36 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:37.399582 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-510106be-3472-4f76-bf4a-7192fad2d1ea tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:37.400286 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-510106be-3472-4f76-bf4a-7192fad2d1ea tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:37.406516 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-510106be-3472-4f76-bf4a-7192fad2d1ea tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:37.409807 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-510106be-3472-4f76-bf4a-7192fad2d1ea tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:37.409807 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-510106be-3472-4f76-bf4a-7192fad2d1ea tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:37.409807 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-510106be-3472-4f76-bf4a-7192fad2d1ea tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:37.409807 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-510106be-3472-4f76-bf4a-7192fad2d1ea tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:37.410686 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-510106be-3472-4f76-bf4a-7192fad2d1ea tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:37.792328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-510106be-3472-4f76-bf4a-7192fad2d1ea tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:37.800100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-510106be-3472-4f76-bf4a-7192fad2d1ea tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.404657 Aug 24 16:45:37.800726 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 101/184] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:37 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:38.822846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6d2cfbf6-ae51-4d36-bcbf-363de9822258 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:38.823446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6d2cfbf6-ae51-4d36-bcbf-363de9822258 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:38.829526 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d2cfbf6-ae51-4d36-bcbf-363de9822258 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:38.830013 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d2cfbf6-ae51-4d36-bcbf-363de9822258 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:38.830446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d2cfbf6-ae51-4d36-bcbf-363de9822258 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:38.831135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d2cfbf6-ae51-4d36-bcbf-363de9822258 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:38.832283 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d2cfbf6-ae51-4d36-bcbf-363de9822258 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:38.832734 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6d2cfbf6-ae51-4d36-bcbf-363de9822258 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:39.072297 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-6d2cfbf6-ae51-4d36-bcbf-363de9822258 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:39.081304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6d2cfbf6-ae51-4d36-bcbf-363de9822258 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.262340 Aug 24 16:45:39.082616 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 84/185] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:38 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:40.107655 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-207e9fdb-0601-46f9-9f6f-6cbc23accd35 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:40.108361 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-207e9fdb-0601-46f9-9f6f-6cbc23accd35 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:40.115157 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207e9fdb-0601-46f9-9f6f-6cbc23accd35 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:40.115718 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207e9fdb-0601-46f9-9f6f-6cbc23accd35 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:40.116221 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207e9fdb-0601-46f9-9f6f-6cbc23accd35 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:40.117070 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207e9fdb-0601-46f9-9f6f-6cbc23accd35 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:40.117621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207e9fdb-0601-46f9-9f6f-6cbc23accd35 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:40.118105 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207e9fdb-0601-46f9-9f6f-6cbc23accd35 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:40.430907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-207e9fdb-0601-46f9-9f6f-6cbc23accd35 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:40.440576 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-207e9fdb-0601-46f9-9f6f-6cbc23accd35 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.336459 Aug 24 16:45:40.461012 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 102/186] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:40 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:41.467743 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-836eceba-c259-4696-a509-2df9604954d1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:41.469413 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-836eceba-c259-4696-a509-2df9604954d1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:41.479127 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-836eceba-c259-4696-a509-2df9604954d1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:41.479622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-836eceba-c259-4696-a509-2df9604954d1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:41.480276 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-836eceba-c259-4696-a509-2df9604954d1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:41.481584 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-836eceba-c259-4696-a509-2df9604954d1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:41.482175 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-836eceba-c259-4696-a509-2df9604954d1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:41.482830 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-836eceba-c259-4696-a509-2df9604954d1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:41.721033 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-836eceba-c259-4696-a509-2df9604954d1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:41.733480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-836eceba-c259-4696-a509-2df9604954d1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1523 microversion: 2.1 time: 0.271019 Aug 24 16:45:41.735815 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 85/187] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:41 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:42.765826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0c006a5a-0976-42a5-aba2-a7d0ab2c653e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:42.766456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0c006a5a-0976-42a5-aba2-a7d0ab2c653e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:42.772780 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=41 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:42.775129 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c006a5a-0976-42a5-aba2-a7d0ab2c653e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:42.776608 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c006a5a-0976-42a5-aba2-a7d0ab2c653e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:42.777226 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c006a5a-0976-42a5-aba2-a7d0ab2c653e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:42.778139 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c006a5a-0976-42a5-aba2-a7d0ab2c653e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:42.780737 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c006a5a-0976-42a5-aba2-a7d0ab2c653e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:42.780737 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c006a5a-0976-42a5-aba2-a7d0ab2c653e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:43.192130 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0c006a5a-0976-42a5-aba2-a7d0ab2c653e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:43.208228 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0c006a5a-0976-42a5-aba2-a7d0ab2c653e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1503 microversion: 2.1 time: 0.446108 Aug 24 16:45:43.209303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 103/188] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:42 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1503 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:43.238637 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b8ae05a1-51c9-46a1-8ab9-b9cb3ef6102d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:43.240439 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b8ae05a1-51c9-46a1-8ab9-b9cb3ef6102d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:43.248981 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8ae05a1-51c9-46a1-8ab9-b9cb3ef6102d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:43.250086 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8ae05a1-51c9-46a1-8ab9-b9cb3ef6102d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:43.250701 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8ae05a1-51c9-46a1-8ab9-b9cb3ef6102d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:43.251716 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8ae05a1-51c9-46a1-8ab9-b9cb3ef6102d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:43.252369 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8ae05a1-51c9-46a1-8ab9-b9cb3ef6102d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:43.252953 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8ae05a1-51c9-46a1-8ab9-b9cb3ef6102d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:43.442697 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b8ae05a1-51c9-46a1-8ab9-b9cb3ef6102d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:43.453251 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b8ae05a1-51c9-46a1-8ab9-b9cb3ef6102d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1517 microversion: 2.1 time: 0.219843 Aug 24 16:45:43.464533 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 86/189] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:43 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:43.809280 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3a8943b5-3fb1-4942-b88b-51649c607c12 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Action: 'create', calling method: .version_select at 0x7f06ac051790>, body: {"keypair": {"name": "tempest-keypair-396998910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM045bSTMYAUhkQxL/WQ06PsJbu42mN5WJt1KhHPRl18xcaJEDKQhWbabBMyv4keG5OdIlz6MbuKSX/AxR+dO/qwjS/Wca2f+hlTRlq6K/NIINhvquXwtTUdmNpKwAthOg=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:43.839971 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-3a8943b5-3fb1-4942-b88b-51649c607c12 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Getting quotas for project 52f30f320fa04cdfa0e1d4ea9050119c. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:45:43.845657 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-3a8943b5-3fb1-4942-b88b-51649c607c12 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Getting quotas for user fc27435df46542a3ac37e743b6399387 and project 52f30f320fa04cdfa0e1d4ea9050119c. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:45:43.955061 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3a8943b5-3fb1-4942-b88b-51649c607c12 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.345082 Aug 24 16:45:43.957028 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 104/190] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Aug 24 16:45:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 347 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 16:45:47.140009 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1503098029", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f60278e-d02a-47e3-ac82-34477071b70e"}], "security_groups": [{"name": "tempest-securitygroup--710053055"}], "key_name": "tempest-keypair-396998910", "user_data": "}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:47.287959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.network.neutron [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] validate_networks() for [('6f60278e-d02a-47e3-ac82-34477071b70e', None, None, None, None, None)] {{(pid=127626) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:45:47.976426 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Flavor limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:45:47.976863 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Image limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:45:47.977350 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Flavor pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:45:47.977758 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Image pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:45:47.978177 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:45:47.991614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:47.991925 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:47.992292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:47.993236 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:47.993925 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:47.995446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:48.028212 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Getting quotas for project 52f30f320fa04cdfa0e1d4ea9050119c. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:45:48.035521 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Getting quotas for user fc27435df46542a3ac37e743b6399387 and project 52f30f320fa04cdfa0e1d4ea9050119c. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:45:48.072960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Going to run 1 instances... {{(pid=127626) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:45:48.076398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:45:48.201559 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-748b78ce-42c8-4758-a1d4-e26952211c0b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.069259 Aug 24 16:45:48.204812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 87/191] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Aug 24 16:45:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 16:45:48.218629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1ba7d391-e959-451b-b866-bf1589c55c10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:48.219339 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1ba7d391-e959-451b-b866-bf1589c55c10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:48.358737 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1ba7d391-e959-451b-b866-bf1589c55c10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:48.379281 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1ba7d391-e959-451b-b866-bf1589c55c10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:48.382680 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1ba7d391-e959-451b-b866-bf1589c55c10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:48.384313 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1ba7d391-e959-451b-b866-bf1589c55c10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1281 microversion: 2.20 time: 0.170913 Aug 24 16:45:48.388437 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 105/192] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:48 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1281 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:49.424234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-182e1357-b05e-4fa6-84e9-d207c38c7854 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:49.425553 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-182e1357-b05e-4fa6-84e9-d207c38c7854 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:49.502991 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-182e1357-b05e-4fa6-84e9-d207c38c7854 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:49.516223 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-182e1357-b05e-4fa6-84e9-d207c38c7854 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:49.519126 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-182e1357-b05e-4fa6-84e9-d207c38c7854 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:49.521155 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-182e1357-b05e-4fa6-84e9-d207c38c7854 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1281 microversion: 2.20 time: 0.101119 Aug 24 16:45:49.522121 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 88/193] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:49 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:49.887434 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-81b9ce2b-3822-40ee-b7cc-be6d45a9db66 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:49.891611 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-81b9ce2b-3822-40ee-b7cc-be6d45a9db66 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:49.904086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81b9ce2b-3822-40ee-b7cc-be6d45a9db66 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:49.905521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81b9ce2b-3822-40ee-b7cc-be6d45a9db66 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:49.912498 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81b9ce2b-3822-40ee-b7cc-be6d45a9db66 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:49.914530 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81b9ce2b-3822-40ee-b7cc-be6d45a9db66 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:49.915870 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81b9ce2b-3822-40ee-b7cc-be6d45a9db66 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:49.917021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81b9ce2b-3822-40ee-b7cc-be6d45a9db66 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:49.967735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-81b9ce2b-3822-40ee-b7cc-be6d45a9db66 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lazy-loading 'flavor' on Instance uuid 033273ba-5c67-47d7-8191-7aa0388f87dc {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:45:50.511093 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-81b9ce2b-3822-40ee-b7cc-be6d45a9db66 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "POST /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc/action" status: 200 len: 32 microversion: 2.1 time: 0.634431 Aug 24 16:45:50.516469 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 106/194] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:45:49 2022] POST /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc/action => generated 32 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:45:50.526800 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9ec58e94-8f09-4c1d-b9e6-22eedec12711 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:50.527734 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9ec58e94-8f09-4c1d-b9e6-22eedec12711 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:50.537278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9ec58e94-8f09-4c1d-b9e6-22eedec12711 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:50.537783 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9ec58e94-8f09-4c1d-b9e6-22eedec12711 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:50.538223 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9ec58e94-8f09-4c1d-b9e6-22eedec12711 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:50.542077 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9ec58e94-8f09-4c1d-b9e6-22eedec12711 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:50.542588 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9ec58e94-8f09-4c1d-b9e6-22eedec12711 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:50.549957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:50.550856 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:50.557063 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9ec58e94-8f09-4c1d-b9e6-22eedec12711 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:50.574245 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:50.574740 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:50.575174 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:50.575880 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:50.576386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:50.577122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:50.689286 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:50.710001 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:50.720559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:50.724910 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f9d05dcb-183f-426a-b319-5bd3714ab828 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1333 microversion: 2.20 time: 0.179358 Aug 24 16:45:50.725544 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 107/195] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:50 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1333 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:50.833244 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9ec58e94-8f09-4c1d-b9e6-22eedec12711 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:50.846100 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9ec58e94-8f09-4c1d-b9e6-22eedec12711 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.325305 Aug 24 16:45:50.847918 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 89/196] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:50 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:51.753311 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:51.754027 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:51.764193 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:51.765010 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:51.765709 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:51.766821 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:51.767539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:51.768910 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:51.858938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:51.868664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:51.870227 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:51.871379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cacbce6d-e9b4-4b10-a1cf-65382fba78b5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1351 microversion: 2.20 time: 0.125846 Aug 24 16:45:51.871977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 108/197] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:51 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:51.873156 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-33b7eab7-4e5c-4f5a-b871-b04cecd22ee1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:51.874126 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-33b7eab7-4e5c-4f5a-b871-b04cecd22ee1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:51.877339 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:51.885724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33b7eab7-4e5c-4f5a-b871-b04cecd22ee1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:51.887475 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33b7eab7-4e5c-4f5a-b871-b04cecd22ee1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:51.887475 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33b7eab7-4e5c-4f5a-b871-b04cecd22ee1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:51.888554 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33b7eab7-4e5c-4f5a-b871-b04cecd22ee1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:51.889260 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33b7eab7-4e5c-4f5a-b871-b04cecd22ee1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:51.890456 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33b7eab7-4e5c-4f5a-b871-b04cecd22ee1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:52.083092 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-33b7eab7-4e5c-4f5a-b871-b04cecd22ee1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:52.095747 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-33b7eab7-4e5c-4f5a-b871-b04cecd22ee1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.227717 Aug 24 16:45:52.096453 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 90/198] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:51 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:52.899792 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:52.900456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:52.906801 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:52.907289 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:52.907715 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:52.908447 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:52.909467 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:52.909892 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:52.932103 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:52.983549 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:52.993396 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:52.994968 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:52.996075 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8816fca6-73c2-4eee-a57a-f96f36a1cc5b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1351 microversion: 2.20 time: 0.100426 Aug 24 16:45:52.999457 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 109/199] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:52 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:53.134409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-06cb7e67-4c9b-4e57-8988-3346c0cee632 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:53.135473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-06cb7e67-4c9b-4e57-8988-3346c0cee632 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:53.146296 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06cb7e67-4c9b-4e57-8988-3346c0cee632 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:53.147231 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06cb7e67-4c9b-4e57-8988-3346c0cee632 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:53.148064 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06cb7e67-4c9b-4e57-8988-3346c0cee632 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:53.148967 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06cb7e67-4c9b-4e57-8988-3346c0cee632 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:53.149450 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06cb7e67-4c9b-4e57-8988-3346c0cee632 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:53.149891 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06cb7e67-4c9b-4e57-8988-3346c0cee632 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:53.156594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:53.327346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-06cb7e67-4c9b-4e57-8988-3346c0cee632 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:53.336055 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-06cb7e67-4c9b-4e57-8988-3346c0cee632 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.211602 Aug 24 16:45:53.336694 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 91/200] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:53 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:54.032959 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:54.035990 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:54.048331 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:54.049911 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:54.051197 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:54.052098 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:54.052942 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:54.053672 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:54.163624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:54.183206 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:54.185501 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:54.186904 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-aff62ca8-b7cf-46a5-b69f-ecdd7796bef2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1351 microversion: 2.20 time: 0.160573 Aug 24 16:45:54.187786 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 110/201] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:54 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:54.365073 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-530faf9a-ae30-4bb7-a449-d416bcbd6d1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:54.366186 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-530faf9a-ae30-4bb7-a449-d416bcbd6d1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:54.384750 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-530faf9a-ae30-4bb7-a449-d416bcbd6d1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:54.384750 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-530faf9a-ae30-4bb7-a449-d416bcbd6d1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:54.384750 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-530faf9a-ae30-4bb7-a449-d416bcbd6d1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:54.384750 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-530faf9a-ae30-4bb7-a449-d416bcbd6d1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:54.390365 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-530faf9a-ae30-4bb7-a449-d416bcbd6d1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:54.390365 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-530faf9a-ae30-4bb7-a449-d416bcbd6d1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:54.679016 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-530faf9a-ae30-4bb7-a449-d416bcbd6d1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:54.695008 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-530faf9a-ae30-4bb7-a449-d416bcbd6d1b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.336823 Aug 24 16:45:54.696282 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 92/202] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:54 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:55.216084 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:55.216659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:55.226839 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:55.227337 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:55.228067 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:55.229500 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:55.230363 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:55.231197 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:55.644534 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:55.670427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:55.685893 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:55.687179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f5ccb552-3065-4c70-8a7b-e170df4c6cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1406 microversion: 2.20 time: 0.479121 Aug 24 16:45:55.688038 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 111/203] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:55 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:55.726554 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-36cb9afc-671f-49c6-8968-e0e56d6158aa tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:55.728690 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-36cb9afc-671f-49c6-8968-e0e56d6158aa tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:55.740759 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-36cb9afc-671f-49c6-8968-e0e56d6158aa tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:55.741774 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-36cb9afc-671f-49c6-8968-e0e56d6158aa tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:55.742453 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-36cb9afc-671f-49c6-8968-e0e56d6158aa tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:55.743860 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-36cb9afc-671f-49c6-8968-e0e56d6158aa tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:55.744445 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-36cb9afc-671f-49c6-8968-e0e56d6158aa tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:55.745272 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-36cb9afc-671f-49c6-8968-e0e56d6158aa tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:56.261173 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-36cb9afc-671f-49c6-8968-e0e56d6158aa tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:56.279974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-36cb9afc-671f-49c6-8968-e0e56d6158aa tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.558882 Aug 24 16:45:56.280617 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 93/204] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:55 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:56.714576 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:56.715772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:56.728049 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:56.728883 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:56.730111 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:56.731640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:56.732724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:56.733796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:56.750420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-8084ab31-524e-4f39-a2e8-51e1cd5c0843 req-3528291b-1dd3-4251-8865-722fa64bc749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eadb4fd-bee8-4fac-b072-550b720e3e95", "tag": "9793be94-7c34-443e-80f4-821b2863ba90"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:56.772825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-8084ab31-524e-4f39-a2e8-51e1cd5c0843 req-3528291b-1dd3-4251-8865-722fa64bc749 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:56.775891 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-8084ab31-524e-4f39-a2e8-51e1cd5c0843 req-3528291b-1dd3-4251-8865-722fa64bc749 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:56.775891 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-8084ab31-524e-4f39-a2e8-51e1cd5c0843 req-3528291b-1dd3-4251-8865-722fa64bc749 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:56.796065 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-8084ab31-524e-4f39-a2e8-51e1cd5c0843 req-3528291b-1dd3-4251-8865-722fa64bc749 service nova] Creating event network-changed:9793be94-7c34-443e-80f4-821b2863ba90 for instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 on hv-cinder-73116 Aug 24 16:45:56.805646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-8084ab31-524e-4f39-a2e8-51e1cd5c0843 req-3528291b-1dd3-4251-8865-722fa64bc749 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071062 Aug 24 16:45:56.806702 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 94/205] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:56.936305 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:56.952327 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:56.955982 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:56.958370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3323a680-cec0-4ee9-9e09-ae6ab8a7e0dc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1406 microversion: 2.20 time: 0.248521 Aug 24 16:45:56.959411 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 112/206] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:56 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:57.315132 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-fa8752de-5f96-48f4-bcd7-0d31a7a27a9e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:57.316635 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-fa8752de-5f96-48f4-bcd7-0d31a7a27a9e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:57.327815 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fa8752de-5f96-48f4-bcd7-0d31a7a27a9e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:57.330196 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fa8752de-5f96-48f4-bcd7-0d31a7a27a9e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:57.330196 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fa8752de-5f96-48f4-bcd7-0d31a7a27a9e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:57.330801 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fa8752de-5f96-48f4-bcd7-0d31a7a27a9e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:57.331642 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fa8752de-5f96-48f4-bcd7-0d31a7a27a9e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:57.332471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fa8752de-5f96-48f4-bcd7-0d31a7a27a9e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:57.529022 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fa8752de-5f96-48f4-bcd7-0d31a7a27a9e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:57.537643 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-fa8752de-5f96-48f4-bcd7-0d31a7a27a9e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.231316 Aug 24 16:45:57.538231 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 95/207] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:57 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:57.998343 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:57.999167 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:58.006684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:58.007225 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:58.007845 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:58.008746 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:58.009299 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:58.009766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:58.169795 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:58.179284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:58.180865 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:58.182006 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f87916ad-5c20-47fe-8011-342245edbf3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1406 microversion: 2.20 time: 0.188558 Aug 24 16:45:58.182574 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 113/208] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:57 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:58.561689 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e9c402cb-8f44-4eb1-a199-fb95f65c9ab0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:58.562817 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e9c402cb-8f44-4eb1-a199-fb95f65c9ab0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:58.566729 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:58.571739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9c402cb-8f44-4eb1-a199-fb95f65c9ab0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:58.572266 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9c402cb-8f44-4eb1-a199-fb95f65c9ab0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:58.572739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9c402cb-8f44-4eb1-a199-fb95f65c9ab0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:58.573446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9c402cb-8f44-4eb1-a199-fb95f65c9ab0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:58.573903 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9c402cb-8f44-4eb1-a199-fb95f65c9ab0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:58.574338 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9c402cb-8f44-4eb1-a199-fb95f65c9ab0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:58.747078 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e9c402cb-8f44-4eb1-a199-fb95f65c9ab0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:58.755367 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e9c402cb-8f44-4eb1-a199-fb95f65c9ab0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.199776 Aug 24 16:45:58.755974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 96/209] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:58 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:59.205105 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:59.206448 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:59.208279 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=6 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:59.213260 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:59.213767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:59.214174 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:59.214869 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:59.215316 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:59.215733 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:59.350903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:59.359517 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:59.361061 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:59.363132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-18fdd882-750b-4bcd-a261-8efe69fda9ff tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1406 microversion: 2.20 time: 0.162019 Aug 24 16:45:59.363700 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 114/210] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:59 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:59.780564 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ef5c0720-6d4d-4861-aa69-8640273579dc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:59.781631 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ef5c0720-6d4d-4861-aa69-8640273579dc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:59.785052 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=8 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:59.789459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ef5c0720-6d4d-4861-aa69-8640273579dc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:59.790014 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ef5c0720-6d4d-4861-aa69-8640273579dc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:59.790447 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ef5c0720-6d4d-4861-aa69-8640273579dc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:59.791150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ef5c0720-6d4d-4861-aa69-8640273579dc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:59.791592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ef5c0720-6d4d-4861-aa69-8640273579dc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:59.792006 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ef5c0720-6d4d-4861-aa69-8640273579dc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:00.022280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ef5c0720-6d4d-4861-aa69-8640273579dc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:00.031210 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ef5c0720-6d4d-4861-aa69-8640273579dc tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.254922 Aug 24 16:46:00.034386 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 97/211] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:59 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:00.387944 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:00.388673 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:00.396053 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:00.396574 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:00.397289 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:00.398406 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:00.398826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:00.399241 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:00.578889 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:00.587869 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:00.589415 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:00.590643 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-899383e2-c266-4790-a8fd-275d350f242b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1406 microversion: 2.20 time: 0.207110 Aug 24 16:46:00.591209 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 115/212] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:00 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:01.062540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2b30d203-f4c4-4f12-aed8-42c9823e2a9c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:01.063235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2b30d203-f4c4-4f12-aed8-42c9823e2a9c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:01.070618 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b30d203-f4c4-4f12-aed8-42c9823e2a9c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:01.071108 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b30d203-f4c4-4f12-aed8-42c9823e2a9c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:01.071605 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b30d203-f4c4-4f12-aed8-42c9823e2a9c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:01.072365 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b30d203-f4c4-4f12-aed8-42c9823e2a9c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:01.072852 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b30d203-f4c4-4f12-aed8-42c9823e2a9c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:01.073278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b30d203-f4c4-4f12-aed8-42c9823e2a9c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:01.261740 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2b30d203-f4c4-4f12-aed8-42c9823e2a9c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:01.272152 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2b30d203-f4c4-4f12-aed8-42c9823e2a9c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.213820 Aug 24 16:46:01.284859 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 98/213] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:01 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:01.615106 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:01.616209 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:01.627315 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:01.629851 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:01.629851 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:01.630119 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:01.630548 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:01.631046 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:01.776553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:01.785889 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:01.787521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:01.788701 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3e7d5911-0ffd-4825-9846-618d47f9a795 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1406 microversion: 2.20 time: 0.179360 Aug 24 16:46:01.789265 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 116/214] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:01 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:02.294060 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0eda519a-349e-43c4-a011-57955ac9992f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:02.294677 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0eda519a-349e-43c4-a011-57955ac9992f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:02.303379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0eda519a-349e-43c4-a011-57955ac9992f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:02.303890 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0eda519a-349e-43c4-a011-57955ac9992f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:02.304325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0eda519a-349e-43c4-a011-57955ac9992f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:02.305092 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0eda519a-349e-43c4-a011-57955ac9992f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:02.305509 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0eda519a-349e-43c4-a011-57955ac9992f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:02.305925 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0eda519a-349e-43c4-a011-57955ac9992f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:02.464751 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0eda519a-349e-43c4-a011-57955ac9992f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:02.472829 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0eda519a-349e-43c4-a011-57955ac9992f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.182491 Aug 24 16:46:02.473415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 99/215] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:02 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:02.811322 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:02.811933 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:02.818784 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:02.819263 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:02.819687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:02.820408 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:02.820858 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:02.821285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:02.967285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:02.984264 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:02.988439 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:02.991344 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fe9d27f3-7ef6-4eb2-99da-bab86c2eeef3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1406 microversion: 2.20 time: 0.183727 Aug 24 16:46:02.992383 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 117/216] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:02 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:03.495171 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-97002724-8cfa-4f70-9130-f8c8a68f3097 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:03.495831 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-97002724-8cfa-4f70-9130-f8c8a68f3097 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:03.502626 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97002724-8cfa-4f70-9130-f8c8a68f3097 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:03.503029 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97002724-8cfa-4f70-9130-f8c8a68f3097 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:03.503469 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97002724-8cfa-4f70-9130-f8c8a68f3097 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:03.504476 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97002724-8cfa-4f70-9130-f8c8a68f3097 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:03.504930 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97002724-8cfa-4f70-9130-f8c8a68f3097 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:03.505353 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97002724-8cfa-4f70-9130-f8c8a68f3097 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:03.674737 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-97002724-8cfa-4f70-9130-f8c8a68f3097 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:03.683183 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-97002724-8cfa-4f70-9130-f8c8a68f3097 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.191840 Aug 24 16:46:03.683973 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 100/217] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:03 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:04.020821 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:04.021530 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:04.027939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:04.028552 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:04.028856 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:04.030376 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:04.030376 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:04.030583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:04.193912 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:04.202507 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:04.204073 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:04.205726 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e5561fa5-9a06-4b5b-9412-74641d2126c2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1406 microversion: 2.20 time: 0.188747 Aug 24 16:46:04.226697 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 118/218] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:04 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:04.707519 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d70f545b-f420-4697-a8bf-8b4acd55fd68 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:04.707519 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d70f545b-f420-4697-a8bf-8b4acd55fd68 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:04.713555 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d70f545b-f420-4697-a8bf-8b4acd55fd68 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:04.714116 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d70f545b-f420-4697-a8bf-8b4acd55fd68 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:04.714468 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d70f545b-f420-4697-a8bf-8b4acd55fd68 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:04.715156 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d70f545b-f420-4697-a8bf-8b4acd55fd68 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:04.715608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d70f545b-f420-4697-a8bf-8b4acd55fd68 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:04.716036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d70f545b-f420-4697-a8bf-8b4acd55fd68 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:04.864526 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d70f545b-f420-4697-a8bf-8b4acd55fd68 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:04.872573 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d70f545b-f420-4697-a8bf-8b4acd55fd68 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.169768 Aug 24 16:46:04.873508 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 101/219] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:04 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:05.232004 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:05.232004 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:05.236045 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:05.236700 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:05.237077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:05.237768 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:05.238214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:05.238630 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:05.383362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:05.391426 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:05.393766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:05.394861 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8c9443c3-88d1-4663-8c7b-57e9ed673e6f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1406 microversion: 2.20 time: 0.169428 Aug 24 16:46:05.395423 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 119/220] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:05 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:05.708888 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-a274a559-afa2-4a7b-b97a-7620ff895ff5 req-9e112c2e-5cf7-44d6-ad5f-aed9331709e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eadb4fd-bee8-4fac-b072-550b720e3e95", "name": "network-vif-plugged", "status": "completed", "tag": "9793be94-7c34-443e-80f4-821b2863ba90"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:05.725173 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-a274a559-afa2-4a7b-b97a-7620ff895ff5 req-9e112c2e-5cf7-44d6-ad5f-aed9331709e2 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:05.725173 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-a274a559-afa2-4a7b-b97a-7620ff895ff5 req-9e112c2e-5cf7-44d6-ad5f-aed9331709e2 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:05.725173 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-a274a559-afa2-4a7b-b97a-7620ff895ff5 req-9e112c2e-5cf7-44d6-ad5f-aed9331709e2 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:05.735006 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-a274a559-afa2-4a7b-b97a-7620ff895ff5 req-9e112c2e-5cf7-44d6-ad5f-aed9331709e2 service nova] Creating event network-vif-plugged:9793be94-7c34-443e-80f4-821b2863ba90 for instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 on hv-cinder-73116 Aug 24 16:46:05.740531 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-a274a559-afa2-4a7b-b97a-7620ff895ff5 req-9e112c2e-5cf7-44d6-ad5f-aed9331709e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036643 Aug 24 16:46:05.741059 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 102/221] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:05.895364 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-93fdfdbf-74bf-438d-9c14-e1906c3a6913 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:05.902831 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-93fdfdbf-74bf-438d-9c14-e1906c3a6913 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:05.902831 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93fdfdbf-74bf-438d-9c14-e1906c3a6913 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:05.907127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93fdfdbf-74bf-438d-9c14-e1906c3a6913 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:05.907492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93fdfdbf-74bf-438d-9c14-e1906c3a6913 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:05.908890 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93fdfdbf-74bf-438d-9c14-e1906c3a6913 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:05.909948 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93fdfdbf-74bf-438d-9c14-e1906c3a6913 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:05.910390 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93fdfdbf-74bf-438d-9c14-e1906c3a6913 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:06.046733 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-93fdfdbf-74bf-438d-9c14-e1906c3a6913 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:06.055704 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-93fdfdbf-74bf-438d-9c14-e1906c3a6913 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.165828 Aug 24 16:46:06.056541 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 120/222] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:05 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:06.417661 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:06.418344 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:06.425160 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:06.425630 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:06.426060 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:06.426735 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:06.427183 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:06.427597 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:06.604106 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:06.614604 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:06.616441 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:06.617761 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-556aebc9-9a53-4e54-9dbd-b9f1f9a8baeb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1406 microversion: 2.20 time: 0.204339 Aug 24 16:46:06.618402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 103/223] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:06 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:46:07.077968 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8ec6afa8-6b9c-4a8b-962e-33fa03efa71a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:07.078888 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8ec6afa8-6b9c-4a8b-962e-33fa03efa71a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:07.085129 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec6afa8-6b9c-4a8b-962e-33fa03efa71a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:07.085626 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec6afa8-6b9c-4a8b-962e-33fa03efa71a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:07.086045 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec6afa8-6b9c-4a8b-962e-33fa03efa71a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:07.086733 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec6afa8-6b9c-4a8b-962e-33fa03efa71a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:07.087184 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec6afa8-6b9c-4a8b-962e-33fa03efa71a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:07.087598 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec6afa8-6b9c-4a8b-962e-33fa03efa71a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:07.222743 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8ec6afa8-6b9c-4a8b-962e-33fa03efa71a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:07.231117 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8ec6afa8-6b9c-4a8b-962e-33fa03efa71a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.157176 Aug 24 16:46:07.231992 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 121/224] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:07 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:07.641810 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:07.642475 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:07.649502 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:07.650002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:07.651078 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:07.651795 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:07.652249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:07.652696 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:07.910059 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:07.919177 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:07.920791 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:07.922014 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-360c81e9-6af2-4858-9e18-ff75265b5d7d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1406 microversion: 2.20 time: 0.284325 Aug 24 16:46:07.922787 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 104/225] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:07 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:08.149940 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9a46ac12-710e-4dc3-b052-cb745711f9ce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:08.149940 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9a46ac12-710e-4dc3-b052-cb745711f9ce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:08.160605 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9a46ac12-710e-4dc3-b052-cb745711f9ce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.162033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9a46ac12-710e-4dc3-b052-cb745711f9ce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.162492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9a46ac12-710e-4dc3-b052-cb745711f9ce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.163206 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9a46ac12-710e-4dc3-b052-cb745711f9ce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.163699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9a46ac12-710e-4dc3-b052-cb745711f9ce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.164061 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9a46ac12-710e-4dc3-b052-cb745711f9ce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.198535 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9a46ac12-710e-4dc3-b052-cb745711f9ce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/ips" status: 200 len: 149 microversion: 2.1 time: 0.057930 Aug 24 16:46:08.199925 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 122/226] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 16:46:08 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/ips => generated 149 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:08.253184 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d52bb918-e9f3-407c-8528-e239af19007a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:08.254054 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d52bb918-e9f3-407c-8528-e239af19007a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:08.260914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d52bb918-e9f3-407c-8528-e239af19007a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.261609 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d52bb918-e9f3-407c-8528-e239af19007a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.262203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d52bb918-e9f3-407c-8528-e239af19007a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.263046 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d52bb918-e9f3-407c-8528-e239af19007a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.263660 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d52bb918-e9f3-407c-8528-e239af19007a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.264353 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d52bb918-e9f3-407c-8528-e239af19007a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.421508 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d52bb918-e9f3-407c-8528-e239af19007a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:08.430426 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d52bb918-e9f3-407c-8528-e239af19007a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1503 microversion: 2.1 time: 0.181128 Aug 24 16:46:08.431175 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 105/227] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:08 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:08.450942 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee4db130-f71d-40e5-97e0-35e15db07425"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:08.453353 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:08.459579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.460068 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.460565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.461262 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.461718 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.462136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.486208 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] HTTP exception thrown: Cannot 'attach_volume' instance 033273ba-5c67-47d7-8191-7aa0388f87dc while it is in vm_state rescued Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Request method failure captured: Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: POST /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc/os-volume_attachments HTTP/1.1 Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 74 Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVrq4otjVfNs1uNhZq-g4sAERo3MCXWw2NQYHqborGd7Oaii9xLab3Pt0-8QlH74mIPv8kZJIE-LFWi6PcEjKsGX7UHEsOkoz3dyJSNGRmFq6On_8oypwQPm4-AgYkuvsGAxniLTuRpvFguDpbYuah9Oi7vrOEdpyuVVMqsr3ehiJM Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: c99d97707cc2485284d8d33522ebb918 Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:46:08.488199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c99d97707cc2485284d8d33522ebb918", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: c99d97707cc2485284d8d33522ebb918 Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-ServerRescueNegativeTestJSON-1231782798-project Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 7be50b041b5947d5909ed6ce516ec8bf Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1231782798-project Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {"volumeAttachment": {"volumeId": "ee4db130-f71d-40e5-97e0-35e15db07425"}} Aug 24 16:46:08.489653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Cannot 'attach_volume' instance 033273ba-5c67-47d7-8191-7aa0388f87dc while it is in vm_state rescued Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'server_id': '033273ba-5c67-47d7-8191-7aa0388f87dc', 'body': {'volumeAttachment': {'volumeId': 'ee4db130-f71d-40e5-97e0-35e15db07425'}}} Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 033273ba-5c67-47d7-8191-7aa0388f87dc in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:46:08.490435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 033273ba-5c67-47d7-8191-7aa0388f87dc while it is in vm_state rescued Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:08.491553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:08.492583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:46:08.492583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:46:08.492583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 033273ba-5c67-47d7-8191-7aa0388f87dc while it is in vm_state rescued Aug 24 16:46:08.492583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:46:08.492583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Returning 409 to user: Cannot 'attach_volume' instance 033273ba-5c67-47d7-8191-7aa0388f87dc while it is in vm_state rescued {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:46:08.492583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1be17677-ec0f-4ecd-ae6d-ce87ad89367b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "POST /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042764 Aug 24 16:46:08.492583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 123/228] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:46:08 2022] POST /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 16:46:08.507766 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-819e22b5-be3d-4e51-a524-c887d5c0fb7e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:08.508790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-819e22b5-be3d-4e51-a524-c887d5c0fb7e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:08.517135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-819e22b5-be3d-4e51-a524-c887d5c0fb7e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.517955 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-819e22b5-be3d-4e51-a524-c887d5c0fb7e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.518579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-819e22b5-be3d-4e51-a524-c887d5c0fb7e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.519465 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-819e22b5-be3d-4e51-a524-c887d5c0fb7e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.520249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-819e22b5-be3d-4e51-a524-c887d5c0fb7e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.520871 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-819e22b5-be3d-4e51-a524-c887d5c0fb7e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.837993 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-819e22b5-be3d-4e51-a524-c887d5c0fb7e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "POST /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc/action" status: 202 len: 0 microversion: 2.1 time: 0.342144 Aug 24 16:46:08.843327 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 106/229] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:46:08 2022] POST /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:46:08.850453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-750ed9c2-6741-48db-b15d-8f4bf8cb9efe tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:08.851195 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-750ed9c2-6741-48db-b15d-8f4bf8cb9efe tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:08.857423 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-750ed9c2-6741-48db-b15d-8f4bf8cb9efe tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.857969 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-750ed9c2-6741-48db-b15d-8f4bf8cb9efe tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.858457 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-750ed9c2-6741-48db-b15d-8f4bf8cb9efe tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.859173 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-750ed9c2-6741-48db-b15d-8f4bf8cb9efe tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.859615 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-750ed9c2-6741-48db-b15d-8f4bf8cb9efe tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.860031 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-750ed9c2-6741-48db-b15d-8f4bf8cb9efe tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.947282 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:08.947992 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:08.965962 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.966742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.967184 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.967909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.971234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.971718 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:09.081516 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-750ed9c2-6741-48db-b15d-8f4bf8cb9efe tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:09.095311 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-750ed9c2-6741-48db-b15d-8f4bf8cb9efe tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1511 microversion: 2.1 time: 0.250380 Aug 24 16:46:09.096095 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 124/230] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:08 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:09.184532 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:09.194476 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:09.195975 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:09.197250 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-349f19a0-17eb-4cb7-8b83-c258d29365b2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1598 microversion: 2.20 time: 0.255791 Aug 24 16:46:09.197891 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 107/231] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:08 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1598 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:09.233804 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-77baa7dd-99be-494c-9eb3-05fcb4a8844a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:09.236573 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-77baa7dd-99be-494c-9eb3-05fcb4a8844a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:09.247364 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77baa7dd-99be-494c-9eb3-05fcb4a8844a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:09.252383 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77baa7dd-99be-494c-9eb3-05fcb4a8844a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:09.252995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77baa7dd-99be-494c-9eb3-05fcb4a8844a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:09.254870 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77baa7dd-99be-494c-9eb3-05fcb4a8844a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:09.255828 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77baa7dd-99be-494c-9eb3-05fcb4a8844a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:09.257558 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77baa7dd-99be-494c-9eb3-05fcb4a8844a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:09.466802 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-77baa7dd-99be-494c-9eb3-05fcb4a8844a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.241538 Aug 24 16:46:09.468843 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 125/232] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Aug 24 16:46:09 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:46:10.121094 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b8476421-fe10-4ada-a06a-888b8530481b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:10.122627 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b8476421-fe10-4ada-a06a-888b8530481b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:10.134790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8476421-fe10-4ada-a06a-888b8530481b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:10.134790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8476421-fe10-4ada-a06a-888b8530481b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:10.135647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8476421-fe10-4ada-a06a-888b8530481b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:10.136967 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8476421-fe10-4ada-a06a-888b8530481b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:10.137652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8476421-fe10-4ada-a06a-888b8530481b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:10.138262 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b8476421-fe10-4ada-a06a-888b8530481b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:10.145760 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:10.405243 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a02752b0-4ab0-4738-893a-1ec5b2922987 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "177ecf19-aeca-459c-a55a-e1977f7e90c1"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:10.418307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a02752b0-4ab0-4738-893a-1ec5b2922987 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:10.427036 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a02752b0-4ab0-4738-893a-1ec5b2922987 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:10.436144 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a02752b0-4ab0-4738-893a-1ec5b2922987 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:10.444776 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a02752b0-4ab0-4738-893a-1ec5b2922987 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:10.445656 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a02752b0-4ab0-4738-893a-1ec5b2922987 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:10.446143 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a02752b0-4ab0-4738-893a-1ec5b2922987 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:10.446586 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a02752b0-4ab0-4738-893a-1ec5b2922987 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:10.678256 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b8476421-fe10-4ada-a06a-888b8530481b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:10.689621 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b8476421-fe10-4ada-a06a-888b8530481b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1511 microversion: 2.1 time: 0.572423 Aug 24 16:46:10.692382 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 108/233] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:10 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1511 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:10.781292 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:11.486533 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a02752b0-4ab0-4738-893a-1ec5b2922987 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.093514 Aug 24 16:46:11.487968 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 126/234] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:46:10 2022] POST /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments => generated 194 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:46:11.631758 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-6716a116-1c41-46f4-a5d1-3c85375c3f13 req-8a469b0c-4a7c-472e-aece-b41934e49141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eadb4fd-bee8-4fac-b072-550b720e3e95", "tag": "9793be94-7c34-443e-80f4-821b2863ba90"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:11.645222 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-6716a116-1c41-46f4-a5d1-3c85375c3f13 req-8a469b0c-4a7c-472e-aece-b41934e49141 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:11.646821 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-6716a116-1c41-46f4-a5d1-3c85375c3f13 req-8a469b0c-4a7c-472e-aece-b41934e49141 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:11.648541 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-6716a116-1c41-46f4-a5d1-3c85375c3f13 req-8a469b0c-4a7c-472e-aece-b41934e49141 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:11.664478 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-6716a116-1c41-46f4-a5d1-3c85375c3f13 req-8a469b0c-4a7c-472e-aece-b41934e49141 service nova] Creating event network-changed:9793be94-7c34-443e-80f4-821b2863ba90 for instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 on hv-cinder-73116 Aug 24 16:46:11.670872 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-6716a116-1c41-46f4-a5d1-3c85375c3f13 req-8a469b0c-4a7c-472e-aece-b41934e49141 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044079 Aug 24 16:46:11.671969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 109/235] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:11.712927 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-73c17d1d-384e-4d89-8820-66d14e746623 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:11.714009 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-73c17d1d-384e-4d89-8820-66d14e746623 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:11.724165 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73c17d1d-384e-4d89-8820-66d14e746623 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:11.724691 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73c17d1d-384e-4d89-8820-66d14e746623 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:11.725120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73c17d1d-384e-4d89-8820-66d14e746623 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:11.725889 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73c17d1d-384e-4d89-8820-66d14e746623 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:11.726276 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73c17d1d-384e-4d89-8820-66d14e746623 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:11.729022 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73c17d1d-384e-4d89-8820-66d14e746623 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:12.019911 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1047253766", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:12.021913 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-73c17d1d-384e-4d89-8820-66d14e746623 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:12.030853 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-73c17d1d-384e-4d89-8820-66d14e746623 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1511 microversion: 2.1 time: 0.322798 Aug 24 16:46:12.033141 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 127/236] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:11 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:12.119797 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.network.neutron [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] validate_networks() for None {{(pid=127626) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:46:12.513692 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Flavor limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:46:12.514384 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Image limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:46:12.515064 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Flavor pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:46:12.515539 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Image pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:46:12.516836 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:46:12.526121 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:12.526675 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:12.527305 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:12.528267 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:12.528951 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:12.529549 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:12.566128 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Getting quotas for project bbd583b569f04997b2ee33b74110ea25. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:46:12.571369 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Getting quotas for user ec16281c5cfd4c2a90b12c097c0a3e0a and project bbd583b569f04997b2ee33b74110ea25. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:46:12.585340 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Going to run 1 instances... {{(pid=127626) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:46:12.587954 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:46:12.820974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-39f80951-f35d-4854-86da-ebdece4b0349 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804284 Aug 24 16:46:12.827505 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 110/237] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 16:46:12.840078 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9fe427d1-f071-4066-9947-d3102fdb99f8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:12.841210 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9fe427d1-f071-4066-9947-d3102fdb99f8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:12.999109 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9fe427d1-f071-4066-9947-d3102fdb99f8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:13.012725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9fe427d1-f071-4066-9947-d3102fdb99f8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1215 microversion: 2.1 time: 0.174011 Aug 24 16:46:13.012725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 128/238] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:12 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:13.056977 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7fc90b14-14cd-4d11-ae64-b3ee6fbd7695 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:13.057665 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7fc90b14-14cd-4d11-ae64-b3ee6fbd7695 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:13.066169 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7fc90b14-14cd-4d11-ae64-b3ee6fbd7695 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:13.066760 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7fc90b14-14cd-4d11-ae64-b3ee6fbd7695 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:13.067261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7fc90b14-14cd-4d11-ae64-b3ee6fbd7695 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:13.068024 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7fc90b14-14cd-4d11-ae64-b3ee6fbd7695 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:13.068619 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7fc90b14-14cd-4d11-ae64-b3ee6fbd7695 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:13.069120 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7fc90b14-14cd-4d11-ae64-b3ee6fbd7695 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:13.262955 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7fc90b14-14cd-4d11-ae64-b3ee6fbd7695 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:13.271990 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7fc90b14-14cd-4d11-ae64-b3ee6fbd7695 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1511 microversion: 2.1 time: 0.218695 Aug 24 16:46:13.273056 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 111/239] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:13 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:14.031660 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4add41ee-5164-461c-8bab-60bc7c6d24ce tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:14.033707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4add41ee-5164-461c-8bab-60bc7c6d24ce tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:14.037801 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:14.158742 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4add41ee-5164-461c-8bab-60bc7c6d24ce tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:14.170541 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4add41ee-5164-461c-8bab-60bc7c6d24ce tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1215 microversion: 2.1 time: 0.142615 Aug 24 16:46:14.171534 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 129/240] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:14 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:14.296299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-131a182a-6d17-49c7-aa13-59858343e3eb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:14.296954 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-131a182a-6d17-49c7-aa13-59858343e3eb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:14.309820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-131a182a-6d17-49c7-aa13-59858343e3eb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:14.310498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-131a182a-6d17-49c7-aa13-59858343e3eb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:14.312110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-131a182a-6d17-49c7-aa13-59858343e3eb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:14.313093 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-131a182a-6d17-49c7-aa13-59858343e3eb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:14.316702 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-131a182a-6d17-49c7-aa13-59858343e3eb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:14.317556 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-131a182a-6d17-49c7-aa13-59858343e3eb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:14.819511 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-131a182a-6d17-49c7-aa13-59858343e3eb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:14.827462 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-131a182a-6d17-49c7-aa13-59858343e3eb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1517 microversion: 2.1 time: 0.536116 Aug 24 16:46:14.828045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 112/241] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:14 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1517 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:15.191531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a9a20f4e-ddfa-4d26-b5e6-3244e4589be1 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:15.192138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a9a20f4e-ddfa-4d26-b5e6-3244e4589be1 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:15.211579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a9a20f4e-ddfa-4d26-b5e6-3244e4589be1 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:15.212071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a9a20f4e-ddfa-4d26-b5e6-3244e4589be1 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:15.212531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a9a20f4e-ddfa-4d26-b5e6-3244e4589be1 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:15.213237 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a9a20f4e-ddfa-4d26-b5e6-3244e4589be1 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:15.213698 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a9a20f4e-ddfa-4d26-b5e6-3244e4589be1 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:15.214121 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a9a20f4e-ddfa-4d26-b5e6-3244e4589be1 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:15.340639 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a9a20f4e-ddfa-4d26-b5e6-3244e4589be1 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:15.350678 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a9a20f4e-ddfa-4d26-b5e6-3244e4589be1 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1219 microversion: 2.1 time: 0.163424 Aug 24 16:46:15.351255 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 130/242] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:15 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:16.372846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-78e7551d-3805-4364-a780-d85172635f30 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:16.374190 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-78e7551d-3805-4364-a780-d85172635f30 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:16.392760 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78e7551d-3805-4364-a780-d85172635f30 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:16.396166 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78e7551d-3805-4364-a780-d85172635f30 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:16.397040 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78e7551d-3805-4364-a780-d85172635f30 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:16.398226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78e7551d-3805-4364-a780-d85172635f30 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:16.400100 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78e7551d-3805-4364-a780-d85172635f30 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:16.400987 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78e7551d-3805-4364-a780-d85172635f30 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:16.601095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-78e7551d-3805-4364-a780-d85172635f30 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:16.602073 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-78e7551d-3805-4364-a780-d85172635f30 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1275 microversion: 2.1 time: 0.234567 Aug 24 16:46:16.602852 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 113/243] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:16 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1275 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:16.696753 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fdac015e-8f43-46f0-ab46-c289a5657135 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Action: 'create', calling method: .version_select at 0x7f06ac05ef70>, body: {"keypair": {"name": "tempest-keypair-1897509407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD27wfh5Jv6gDOaQl1Ru6vyl2KzzTL1CQPiYG20O6aNme1WQZSrOr2IysDs18CRvJ0hbIuvKok1+4USMwy4fPYA1aTaA1qhS4TOe/XAxB0bsz4NLR/cVR7Zi03SZW9qNZA=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:16.719899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-fdac015e-8f43-46f0-ab46-c289a5657135 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Getting quotas for project c99d97707cc2485284d8d33522ebb918. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:46:16.724650 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-fdac015e-8f43-46f0-ab46-c289a5657135 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Getting quotas for user 7be50b041b5947d5909ed6ce516ec8bf and project c99d97707cc2485284d8d33522ebb918. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:46:16.853442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fdac015e-8f43-46f0-ab46-c289a5657135 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.160577 Aug 24 16:46:16.853872 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 131/244] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 16:46:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:17.631969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-dcfa0daf-3989-4486-be1d-f0dc89826102 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:17.633284 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-dcfa0daf-3989-4486-be1d-f0dc89826102 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:17.645432 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dcfa0daf-3989-4486-be1d-f0dc89826102 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:17.646368 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dcfa0daf-3989-4486-be1d-f0dc89826102 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:17.649373 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dcfa0daf-3989-4486-be1d-f0dc89826102 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:17.652900 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dcfa0daf-3989-4486-be1d-f0dc89826102 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:17.653599 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dcfa0daf-3989-4486-be1d-f0dc89826102 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:17.654184 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dcfa0daf-3989-4486-be1d-f0dc89826102 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:17.751454 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-dcfa0daf-3989-4486-be1d-f0dc89826102 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:17.763170 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-dcfa0daf-3989-4486-be1d-f0dc89826102 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1273 microversion: 2.1 time: 0.140161 Aug 24 16:46:17.770014 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 114/245] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:17 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:18.770194 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9f78b7f2-4b07-43e0-8832-79653fb28485 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:18.770759 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9f78b7f2-4b07-43e0-8832-79653fb28485 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:18.785958 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-71b644bf-985a-4cbc-bb5b-2d00e44446d4 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:18.786568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-71b644bf-985a-4cbc-bb5b-2d00e44446d4 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:18.800202 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b644bf-985a-4cbc-bb5b-2d00e44446d4 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:18.800722 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b644bf-985a-4cbc-bb5b-2d00e44446d4 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:18.801158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b644bf-985a-4cbc-bb5b-2d00e44446d4 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:18.808469 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f78b7f2-4b07-43e0-8832-79653fb28485 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:18.809275 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f78b7f2-4b07-43e0-8832-79653fb28485 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:18.809423 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f78b7f2-4b07-43e0-8832-79653fb28485 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:18.810090 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f78b7f2-4b07-43e0-8832-79653fb28485 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:18.810538 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f78b7f2-4b07-43e0-8832-79653fb28485 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:18.810955 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f78b7f2-4b07-43e0-8832-79653fb28485 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:18.813204 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b644bf-985a-4cbc-bb5b-2d00e44446d4 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:18.813744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b644bf-985a-4cbc-bb5b-2d00e44446d4 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:18.823954 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71b644bf-985a-4cbc-bb5b-2d00e44446d4 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:18.880034 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9f78b7f2-4b07-43e0-8832-79653fb28485 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/ips" status: 200 len: 146 microversion: 2.1 time: 0.114905 Aug 24 16:46:18.883591 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 132/246] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 16:46:18 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/ips => generated 146 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:19.439951 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-71b644bf-985a-4cbc-bb5b-2d00e44446d4 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:19.450920 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-71b644bf-985a-4cbc-bb5b-2d00e44446d4 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1315 microversion: 2.1 time: 0.668385 Aug 24 16:46:19.451757 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 115/247] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:18 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:19.977070 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-0de26b41-4f11-4822-9875-c70cc35499ae req-c7a1e82d-aae3-47d3-a47a-9862da5ebde7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba54a89-d4d3-4d77-aa35-bf744968c331", "tag": "b4a6135d-99c4-4c1b-bbe4-97294bfe7cfb"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:19.994570 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-0de26b41-4f11-4822-9875-c70cc35499ae req-c7a1e82d-aae3-47d3-a47a-9862da5ebde7 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:19.996040 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-0de26b41-4f11-4822-9875-c70cc35499ae req-c7a1e82d-aae3-47d3-a47a-9862da5ebde7 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:19.996504 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-0de26b41-4f11-4822-9875-c70cc35499ae req-c7a1e82d-aae3-47d3-a47a-9862da5ebde7 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:20.025477 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-0de26b41-4f11-4822-9875-c70cc35499ae req-c7a1e82d-aae3-47d3-a47a-9862da5ebde7 service nova] Creating event network-changed:b4a6135d-99c4-4c1b-bbe4-97294bfe7cfb for instance 7ba54a89-d4d3-4d77-aa35-bf744968c331 on hv-cinder-73116 Aug 24 16:46:20.031023 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-0de26b41-4f11-4822-9875-c70cc35499ae req-c7a1e82d-aae3-47d3-a47a-9862da5ebde7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057969 Aug 24 16:46:20.032878 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 133/248] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:20.483453 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-16da12d6-e996-493f-a8bb-c0b9fda88006 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:20.485334 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-16da12d6-e996-493f-a8bb-c0b9fda88006 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:20.505384 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-16da12d6-e996-493f-a8bb-c0b9fda88006 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:20.507491 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-16da12d6-e996-493f-a8bb-c0b9fda88006 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:20.512134 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-16da12d6-e996-493f-a8bb-c0b9fda88006 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:20.513401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-16da12d6-e996-493f-a8bb-c0b9fda88006 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:20.513884 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-16da12d6-e996-493f-a8bb-c0b9fda88006 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:20.514318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-16da12d6-e996-493f-a8bb-c0b9fda88006 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:21.257622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-16da12d6-e996-493f-a8bb-c0b9fda88006 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:21.286148 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-16da12d6-e996-493f-a8bb-c0b9fda88006 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1315 microversion: 2.1 time: 0.811880 Aug 24 16:46:21.287277 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 116/249] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:20 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:21.579473 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-afe17066-e2a8-4716-97e9-39add7e0db67 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: .version_select at 0x7f06a7795280>, body: {"keypair": {"name": "tempest-keypair-1394085887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMybqsyNa2Hg0jOTRY9MP9nyEQFKme8Sq4ba+1e9d8FpiyWs3DyQoWH5KJ7JSgoRhbdfuHls4amiYDoVu4MtvX9G91YEacaRrb8KdeFpRDGg9UcCRrMHwYoL9zXMLt0tw=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:21.600774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-afe17066-e2a8-4716-97e9-39add7e0db67 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:46:21.605317 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-afe17066-e2a8-4716-97e9-39add7e0db67 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for user 1d9f7755863d45bfb04a1498bd62e367 and project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:46:21.721312 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-afe17066-e2a8-4716-97e9-39add7e0db67 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.148993 Aug 24 16:46:21.721921 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 134/250] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 16:46:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:21.815790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-150030481", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d88a69f-ea66-4ba4-9592-a2ab513e73da"}], "security_groups": [{"name": "tempest-securitygroup--1458149614"}], "key_name": "tempest-keypair-1897509407", "user_data": "}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:21.939238 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7a70ba8c-8d15-4f70-ade1-b9769266dbc3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cd33dbf-d0bc-49f0-a76c-1f7aae7a7258"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:21.942687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7a70ba8c-8d15-4f70-ade1-b9769266dbc3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:21.964208 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a70ba8c-8d15-4f70-ade1-b9769266dbc3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:21.971154 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a70ba8c-8d15-4f70-ade1-b9769266dbc3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:21.974615 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a70ba8c-8d15-4f70-ade1-b9769266dbc3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:21.978694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a70ba8c-8d15-4f70-ade1-b9769266dbc3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:21.979632 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a70ba8c-8d15-4f70-ade1-b9769266dbc3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:21.980677 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a70ba8c-8d15-4f70-ade1-b9769266dbc3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:22.083973 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.network.neutron [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] validate_networks() for [('4d88a69f-ea66-4ba4-9592-a2ab513e73da', None, None, None, None, None)] {{(pid=127626) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:46:22.511487 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:22.542749 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:22.579221 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=6 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:22.832002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Flavor limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:46:22.832664 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Image limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:46:22.832914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Flavor pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:46:22.833323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Image pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:46:22.833740 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:46:22.843275 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:22.844007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:22.845349 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:22.846286 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:22.847168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:22.847728 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:22.870721 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Getting quotas for project c99d97707cc2485284d8d33522ebb918. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:46:22.876371 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Getting quotas for user 7be50b041b5947d5909ed6ce516ec8bf and project c99d97707cc2485284d8d33522ebb918. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:46:22.888998 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Going to run 1 instances... {{(pid=127626) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:46:22.891771 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:46:23.044049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-cbe8c9d9-0e64-47fb-9b95-01637a0eb152 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.234946 Aug 24 16:46:23.051910 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 117/251] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:46:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:46:23.057118 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-22229d1d-c6fb-4bea-8403-1302f7bf4591 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:23.057752 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-22229d1d-c6fb-4bea-8403-1302f7bf4591 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:23.064804 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-22229d1d-c6fb-4bea-8403-1302f7bf4591 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:23.065299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-22229d1d-c6fb-4bea-8403-1302f7bf4591 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:23.065734 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-22229d1d-c6fb-4bea-8403-1302f7bf4591 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:23.066613 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-22229d1d-c6fb-4bea-8403-1302f7bf4591 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:23.067069 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-22229d1d-c6fb-4bea-8403-1302f7bf4591 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:23.067490 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-22229d1d-c6fb-4bea-8403-1302f7bf4591 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:23.114982 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7a70ba8c-8d15-4f70-ade1-b9769266dbc3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "POST /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.182948 Aug 24 16:46:23.116951 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 135/252] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:46:21 2022] POST /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/os-volume_attachments => generated 194 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:23.141119 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b1f00da0-8eab-4a31-9289-9348b495058b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:23.142226 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b1f00da0-8eab-4a31-9289-9348b495058b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:23.291065 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b1f00da0-8eab-4a31-9289-9348b495058b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:23.310946 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b1f00da0-8eab-4a31-9289-9348b495058b tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1245 microversion: 2.1 time: 0.186831 Aug 24 16:46:23.310946 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 136/253] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:23 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1245 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:23.330254 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-22229d1d-c6fb-4bea-8403-1302f7bf4591 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:23.338278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-22229d1d-c6fb-4bea-8403-1302f7bf4591 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1315 microversion: 2.1 time: 0.285316 Aug 24 16:46:23.339160 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 118/254] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:23 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:24.329208 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4e93f31b-9b7f-4a7a-bf00-458fa26c54c0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:24.330452 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4e93f31b-9b7f-4a7a-bf00-458fa26c54c0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:24.346399 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e93f31b-9b7f-4a7a-bf00-458fa26c54c0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:24.346911 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e93f31b-9b7f-4a7a-bf00-458fa26c54c0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:24.347355 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e93f31b-9b7f-4a7a-bf00-458fa26c54c0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:24.348077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e93f31b-9b7f-4a7a-bf00-458fa26c54c0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:24.348562 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e93f31b-9b7f-4a7a-bf00-458fa26c54c0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:24.348989 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e93f31b-9b7f-4a7a-bf00-458fa26c54c0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:24.365334 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-41c0e3c8-f935-4928-a0ac-e50a018472d3 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:24.367111 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-41c0e3c8-f935-4928-a0ac-e50a018472d3 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:24.393157 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41c0e3c8-f935-4928-a0ac-e50a018472d3 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:24.393643 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41c0e3c8-f935-4928-a0ac-e50a018472d3 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:24.397724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41c0e3c8-f935-4928-a0ac-e50a018472d3 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:24.398696 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41c0e3c8-f935-4928-a0ac-e50a018472d3 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:24.399168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41c0e3c8-f935-4928-a0ac-e50a018472d3 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:24.399599 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41c0e3c8-f935-4928-a0ac-e50a018472d3 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:24.518644 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4e93f31b-9b7f-4a7a-bf00-458fa26c54c0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:24.537680 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4e93f31b-9b7f-4a7a-bf00-458fa26c54c0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1249 microversion: 2.1 time: 0.214151 Aug 24 16:46:24.549038 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 137/255] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:24 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1249 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:24.903549 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-41c0e3c8-f935-4928-a0ac-e50a018472d3 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:24.914920 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-41c0e3c8-f935-4928-a0ac-e50a018472d3 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1315 microversion: 2.1 time: 0.557248 Aug 24 16:46:24.915515 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 119/256] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:24 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:25.182640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-352732478", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "883b1cf6-8114-4681-9877-f2163f4c86c7"}], "security_groups": [{"name": "tempest-securitygroup--1490235288"}], "key_name": "tempest-keypair-1394085887", "user_data": "}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:25.340828 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] validate_networks() for [('883b1cf6-8114-4681-9877-f2163f4c86c7', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:46:25.614244 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-483feeb1-275d-495f-9d40-82634738b61e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Action: 'create', calling method: .version_select at 0x7f06a6f7f040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1562779701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkqICNtV+vqBW99aGhhiiMa0QGtVPB0xxJaLtJcRSLEgKC5WUuhUxQsW17wAb7FgyfPoDGY7rSDnVB1ptk1N+womo13KdRDpDd1wsFcRWrM5C0Q/r/FU7EtX/aJWns2Tg=="}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:25.632902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-483feeb1-275d-495f-9d40-82634738b61e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Getting quotas for project 05a8a1a0e0334559ab3fc9a63685fa69. Resources: {'key_pairs'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:46:25.637768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-483feeb1-275d-495f-9d40-82634738b61e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Getting quotas for user 5f10bf98bc784be7bf2f8fde1ddbef44 and project 05a8a1a0e0334559ab3fc9a63685fa69. Resources: {'key_pairs'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:46:25.769379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-483feeb1-275d-495f-9d40-82634738b61e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.412927 Aug 24 16:46:25.770030 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 120/257] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 16:46:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:25.775147 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2860905e-2498-4752-af72-7ed36dc5f8c1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:25.775862 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2860905e-2498-4752-af72-7ed36dc5f8c1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:25.797918 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2860905e-2498-4752-af72-7ed36dc5f8c1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:25.798651 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2860905e-2498-4752-af72-7ed36dc5f8c1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:25.799282 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2860905e-2498-4752-af72-7ed36dc5f8c1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:25.800607 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2860905e-2498-4752-af72-7ed36dc5f8c1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:25.801354 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2860905e-2498-4752-af72-7ed36dc5f8c1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:25.802307 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2860905e-2498-4752-af72-7ed36dc5f8c1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:25.983488 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2860905e-2498-4752-af72-7ed36dc5f8c1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:26.000651 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2860905e-2498-4752-af72-7ed36dc5f8c1 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1305 microversion: 2.1 time: 0.226574 Aug 24 16:46:26.004882 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 121/258] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:25 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1305 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:26.014063 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8a6a8eef-9980-4b50-b7d7-6d9b13f62b28 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:26.020709 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8a6a8eef-9980-4b50-b7d7-6d9b13f62b28 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:26.030019 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8a6a8eef-9980-4b50-b7d7-6d9b13f62b28 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:26.031950 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8a6a8eef-9980-4b50-b7d7-6d9b13f62b28 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:26.032646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8a6a8eef-9980-4b50-b7d7-6d9b13f62b28 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:26.033565 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8a6a8eef-9980-4b50-b7d7-6d9b13f62b28 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:26.034302 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8a6a8eef-9980-4b50-b7d7-6d9b13f62b28 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:26.035194 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8a6a8eef-9980-4b50-b7d7-6d9b13f62b28 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:26.197846 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:46:26.201554 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:46:26.202298 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:46:26.205023 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:46:26.205650 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:46:26.227051 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:26.227537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:26.228161 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:26.229537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:26.230213 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:26.230799 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:26.263725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:46:26.272995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for user 1d9f7755863d45bfb04a1498bd62e367 and project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:46:26.291151 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:46:26.296033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:46:26.362306 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8a6a8eef-9980-4b50-b7d7-6d9b13f62b28 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:26.376937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8a6a8eef-9980-4b50-b7d7-6d9b13f62b28 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1315 microversion: 2.1 time: 0.366955 Aug 24 16:46:26.376937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 122/259] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:26 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:26.450782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ce17b373-f0a1-4083-b923-17fddea6e7e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.275208 Aug 24 16:46:26.457546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 138/260] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:46:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:46:26.470805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-46c5e7da-2909-4bd4-8a22-ee64f57412e3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:26.474370 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-46c5e7da-2909-4bd4-8a22-ee64f57412e3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:26.654817 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-46c5e7da-2909-4bd4-8a22-ee64f57412e3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:26.654817 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-46c5e7da-2909-4bd4-8a22-ee64f57412e3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1241 microversion: 2.1 time: 0.131485 Aug 24 16:46:26.654817 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 123/261] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:26 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:27.027554 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4e105f70-9076-4b33-b67b-d8c03ea149c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:27.028663 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4e105f70-9076-4b33-b67b-d8c03ea149c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:27.039316 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e105f70-9076-4b33-b67b-d8c03ea149c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:27.039316 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e105f70-9076-4b33-b67b-d8c03ea149c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:27.040058 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e105f70-9076-4b33-b67b-d8c03ea149c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:27.041147 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e105f70-9076-4b33-b67b-d8c03ea149c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:27.042213 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e105f70-9076-4b33-b67b-d8c03ea149c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:27.043258 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e105f70-9076-4b33-b67b-d8c03ea149c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:27.139258 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4e105f70-9076-4b33-b67b-d8c03ea149c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:27.147318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4e105f70-9076-4b33-b67b-d8c03ea149c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1303 microversion: 2.1 time: 0.124598 Aug 24 16:46:27.153830 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 139/262] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:27 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:27.399185 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0c96bbc4-2188-41fd-b1b4-eb747451e70d tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:27.399841 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0c96bbc4-2188-41fd-b1b4-eb747451e70d tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:27.408324 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0c96bbc4-2188-41fd-b1b4-eb747451e70d tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:27.408849 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0c96bbc4-2188-41fd-b1b4-eb747451e70d tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:27.410906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0c96bbc4-2188-41fd-b1b4-eb747451e70d tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:27.410906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0c96bbc4-2188-41fd-b1b4-eb747451e70d tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:27.410906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0c96bbc4-2188-41fd-b1b4-eb747451e70d tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:27.410906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0c96bbc4-2188-41fd-b1b4-eb747451e70d tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:27.657957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-64d05a3a-8955-4ead-900d-0edd4d0a013e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:27.660688 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-64d05a3a-8955-4ead-900d-0edd4d0a013e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:27.675637 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d05a3a-8955-4ead-900d-0edd4d0a013e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:27.675908 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d05a3a-8955-4ead-900d-0edd4d0a013e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:27.679020 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d05a3a-8955-4ead-900d-0edd4d0a013e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:27.679941 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d05a3a-8955-4ead-900d-0edd4d0a013e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:27.680437 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d05a3a-8955-4ead-900d-0edd4d0a013e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:27.680865 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d05a3a-8955-4ead-900d-0edd4d0a013e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:27.777239 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0c96bbc4-2188-41fd-b1b4-eb747451e70d tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:27.806096 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0c96bbc4-2188-41fd-b1b4-eb747451e70d tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1315 microversion: 2.1 time: 0.410525 Aug 24 16:46:27.808914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 124/263] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:27 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:27.821747 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-64d05a3a-8955-4ead-900d-0edd4d0a013e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:27.833127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-64d05a3a-8955-4ead-900d-0edd4d0a013e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1245 microversion: 2.1 time: 0.181042 Aug 24 16:46:27.833907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 140/264] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:27 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1245 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:27.972897 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-1ec97f71-f319-4725-b2df-2b729d4ea1e6 req-3a92261a-cbe0-4e60-81ad-5ea9bfbd0b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba54a89-d4d3-4d77-aa35-bf744968c331", "name": "network-vif-plugged", "status": "completed", "tag": "b4a6135d-99c4-4c1b-bbe4-97294bfe7cfb"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:28.002180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-1ec97f71-f319-4725-b2df-2b729d4ea1e6 req-3a92261a-cbe0-4e60-81ad-5ea9bfbd0b8d service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:28.002962 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-1ec97f71-f319-4725-b2df-2b729d4ea1e6 req-3a92261a-cbe0-4e60-81ad-5ea9bfbd0b8d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:28.003552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-1ec97f71-f319-4725-b2df-2b729d4ea1e6 req-3a92261a-cbe0-4e60-81ad-5ea9bfbd0b8d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:28.017995 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-1ec97f71-f319-4725-b2df-2b729d4ea1e6 req-3a92261a-cbe0-4e60-81ad-5ea9bfbd0b8d service nova] Creating event network-vif-plugged:b4a6135d-99c4-4c1b-bbe4-97294bfe7cfb for instance 7ba54a89-d4d3-4d77-aa35-bf744968c331 on hv-cinder-73116 Aug 24 16:46:28.024296 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-1ec97f71-f319-4725-b2df-2b729d4ea1e6 req-3a92261a-cbe0-4e60-81ad-5ea9bfbd0b8d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063325 Aug 24 16:46:28.025433 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 125/265] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:28.169681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d53276b9-b12b-40c9-bf49-b2ee76742fbf tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:28.170441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d53276b9-b12b-40c9-bf49-b2ee76742fbf tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:28.185495 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53276b9-b12b-40c9-bf49-b2ee76742fbf tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:28.188863 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53276b9-b12b-40c9-bf49-b2ee76742fbf tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:28.190797 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53276b9-b12b-40c9-bf49-b2ee76742fbf tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:28.192769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53276b9-b12b-40c9-bf49-b2ee76742fbf tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:28.194152 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53276b9-b12b-40c9-bf49-b2ee76742fbf tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:28.196762 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53276b9-b12b-40c9-bf49-b2ee76742fbf tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:28.533011 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d53276b9-b12b-40c9-bf49-b2ee76742fbf tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:28.544524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d53276b9-b12b-40c9-bf49-b2ee76742fbf tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.378673 Aug 24 16:46:28.546300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 141/266] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:28 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:28.831622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2267e9bc-1c37-4aa1-9db2-f56d64123c3a tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:28.832314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2267e9bc-1c37-4aa1-9db2-f56d64123c3a tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:28.839721 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2267e9bc-1c37-4aa1-9db2-f56d64123c3a tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:28.840208 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2267e9bc-1c37-4aa1-9db2-f56d64123c3a tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:28.840700 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2267e9bc-1c37-4aa1-9db2-f56d64123c3a tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:28.845436 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2267e9bc-1c37-4aa1-9db2-f56d64123c3a tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:28.845436 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2267e9bc-1c37-4aa1-9db2-f56d64123c3a tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:28.845436 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2267e9bc-1c37-4aa1-9db2-f56d64123c3a tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:28.854290 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-13a63784-8b77-47f0-b84d-b0ec7707b6ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:28.854961 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-13a63784-8b77-47f0-b84d-b0ec7707b6ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:28.862203 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a63784-8b77-47f0-b84d-b0ec7707b6ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:28.862774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a63784-8b77-47f0-b84d-b0ec7707b6ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:28.863271 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a63784-8b77-47f0-b84d-b0ec7707b6ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:28.864920 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a63784-8b77-47f0-b84d-b0ec7707b6ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:28.865769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a63784-8b77-47f0-b84d-b0ec7707b6ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:28.866703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a63784-8b77-47f0-b84d-b0ec7707b6ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:28.970028 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-13a63784-8b77-47f0-b84d-b0ec7707b6ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:28.978663 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-13a63784-8b77-47f0-b84d-b0ec7707b6ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1301 microversion: 2.1 time: 0.128415 Aug 24 16:46:28.979362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 142/267] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:28 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1301 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:29.061572 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-671e38f6-a1c8-4b1f-94ff-4f68d7ea186d req-0e8ee085-c85a-4398-8e89-c2f3196fd15c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e8d907-5a6d-450e-92bc-a4ee16bde539", "tag": "d972466c-37b3-4485-ba2b-6a1659a3de80"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:29.073829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-671e38f6-a1c8-4b1f-94ff-4f68d7ea186d req-0e8ee085-c85a-4398-8e89-c2f3196fd15c service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:29.074578 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-671e38f6-a1c8-4b1f-94ff-4f68d7ea186d req-0e8ee085-c85a-4398-8e89-c2f3196fd15c service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:29.075014 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-671e38f6-a1c8-4b1f-94ff-4f68d7ea186d req-0e8ee085-c85a-4398-8e89-c2f3196fd15c service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:29.087469 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2267e9bc-1c37-4aa1-9db2-f56d64123c3a tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:29.099512 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2267e9bc-1c37-4aa1-9db2-f56d64123c3a tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1315 microversion: 2.1 time: 0.273638 Aug 24 16:46:29.100609 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 126/268] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:28 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:29.244528 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-671e38f6-a1c8-4b1f-94ff-4f68d7ea186d req-0e8ee085-c85a-4398-8e89-c2f3196fd15c service nova] Creating event network-changed:d972466c-37b3-4485-ba2b-6a1659a3de80 for instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 on hv-cinder-73116 Aug 24 16:46:29.245684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-671e38f6-a1c8-4b1f-94ff-4f68d7ea186d req-0e8ee085-c85a-4398-8e89-c2f3196fd15c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188106 Aug 24 16:46:29.246544 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 143/269] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:46:29.566301 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-27481c60-2988-4e84-8399-4ab1a7a6e3c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:29.566917 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-27481c60-2988-4e84-8399-4ab1a7a6e3c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:29.572948 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27481c60-2988-4e84-8399-4ab1a7a6e3c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:29.574705 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27481c60-2988-4e84-8399-4ab1a7a6e3c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:29.575165 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27481c60-2988-4e84-8399-4ab1a7a6e3c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:29.575874 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27481c60-2988-4e84-8399-4ab1a7a6e3c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:29.576358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27481c60-2988-4e84-8399-4ab1a7a6e3c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:29.576995 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27481c60-2988-4e84-8399-4ab1a7a6e3c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:29.715404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-27481c60-2988-4e84-8399-4ab1a7a6e3c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:29.729419 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-27481c60-2988-4e84-8399-4ab1a7a6e3c2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.167196 Aug 24 16:46:29.730144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 127/270] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:29 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:30.003310 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-133640e7-39fa-414c-b104-7acc343171fa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:30.004023 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-133640e7-39fa-414c-b104-7acc343171fa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:30.012987 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-133640e7-39fa-414c-b104-7acc343171fa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:30.013481 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-133640e7-39fa-414c-b104-7acc343171fa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:30.013909 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-133640e7-39fa-414c-b104-7acc343171fa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:30.014608 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-133640e7-39fa-414c-b104-7acc343171fa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:30.015071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-133640e7-39fa-414c-b104-7acc343171fa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:30.015666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-133640e7-39fa-414c-b104-7acc343171fa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:30.121283 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-944768eb-d838-4950-8fae-97e8ca504f6b tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:30.126079 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-944768eb-d838-4950-8fae-97e8ca504f6b tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:30.147867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-944768eb-d838-4950-8fae-97e8ca504f6b tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:30.148401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-944768eb-d838-4950-8fae-97e8ca504f6b tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:30.149016 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-944768eb-d838-4950-8fae-97e8ca504f6b tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:30.156681 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-944768eb-d838-4950-8fae-97e8ca504f6b tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:30.157183 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-944768eb-d838-4950-8fae-97e8ca504f6b tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:30.157629 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-944768eb-d838-4950-8fae-97e8ca504f6b tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:30.191971 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-133640e7-39fa-414c-b104-7acc343171fa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:30.200283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-133640e7-39fa-414c-b104-7acc343171fa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1311 microversion: 2.1 time: 0.204689 Aug 24 16:46:30.213145 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 144/271] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:29 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1311 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:30.340530 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-944768eb-d838-4950-8fae-97e8ca504f6b tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:30.349144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-944768eb-d838-4950-8fae-97e8ca504f6b tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1315 microversion: 2.1 time: 0.231588 Aug 24 16:46:30.349764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 128/272] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:30 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:30.752010 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-14ed7a6c-b199-4af9-bccd-de28d2195a3c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:30.752648 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-14ed7a6c-b199-4af9-bccd-de28d2195a3c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:30.758914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14ed7a6c-b199-4af9-bccd-de28d2195a3c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:30.759402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14ed7a6c-b199-4af9-bccd-de28d2195a3c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:30.759826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14ed7a6c-b199-4af9-bccd-de28d2195a3c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:30.760530 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14ed7a6c-b199-4af9-bccd-de28d2195a3c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:30.760974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14ed7a6c-b199-4af9-bccd-de28d2195a3c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:30.761388 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14ed7a6c-b199-4af9-bccd-de28d2195a3c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:30.990851 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14ed7a6c-b199-4af9-bccd-de28d2195a3c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:31.000618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-14ed7a6c-b199-4af9-bccd-de28d2195a3c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.252404 Aug 24 16:46:31.001439 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 145/273] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:30 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:31.223768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2bfa79b0-3b32-4a82-8bd5-df58b6d31f56 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:31.224398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2bfa79b0-3b32-4a82-8bd5-df58b6d31f56 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:31.234307 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2bfa79b0-3b32-4a82-8bd5-df58b6d31f56 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:31.235128 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2bfa79b0-3b32-4a82-8bd5-df58b6d31f56 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:31.235849 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2bfa79b0-3b32-4a82-8bd5-df58b6d31f56 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:31.236558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2bfa79b0-3b32-4a82-8bd5-df58b6d31f56 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:31.237042 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2bfa79b0-3b32-4a82-8bd5-df58b6d31f56 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:31.237630 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2bfa79b0-3b32-4a82-8bd5-df58b6d31f56 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:31.258789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=100 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:31.373244 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a34078cb-e4f4-4845-848b-83e4f8b98658 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:31.375421 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a34078cb-e4f4-4845-848b-83e4f8b98658 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:31.386575 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a34078cb-e4f4-4845-848b-83e4f8b98658 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:31.391480 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a34078cb-e4f4-4845-848b-83e4f8b98658 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:31.392336 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a34078cb-e4f4-4845-848b-83e4f8b98658 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:31.393152 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a34078cb-e4f4-4845-848b-83e4f8b98658 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:31.393707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a34078cb-e4f4-4845-848b-83e4f8b98658 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:31.394442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a34078cb-e4f4-4845-848b-83e4f8b98658 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:31.560762 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2bfa79b0-3b32-4a82-8bd5-df58b6d31f56 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:31.570751 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2bfa79b0-3b32-4a82-8bd5-df58b6d31f56 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.351355 Aug 24 16:46:31.571337 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 129/274] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:31 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:31.785899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a34078cb-e4f4-4845-848b-83e4f8b98658 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:31.798088 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a34078cb-e4f4-4845-848b-83e4f8b98658 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1464 microversion: 2.1 time: 0.430913 Aug 24 16:46:31.799014 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 146/275] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:31 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1464 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:31.925857 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5a7d4379-ed9d-4ed6-b796-a168f590c826 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:31.926353 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-5a7d4379-ed9d-4ed6-b796-a168f590c826 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:31.932986 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a7d4379-ed9d-4ed6-b796-a168f590c826 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:31.934208 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a7d4379-ed9d-4ed6-b796-a168f590c826 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:31.935233 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a7d4379-ed9d-4ed6-b796-a168f590c826 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:31.936298 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a7d4379-ed9d-4ed6-b796-a168f590c826 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:31.937290 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a7d4379-ed9d-4ed6-b796-a168f590c826 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:31.937917 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a7d4379-ed9d-4ed6-b796-a168f590c826 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:31.973732 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-5a7d4379-ed9d-4ed6-b796-a168f590c826 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Going to try to terminate instance {{(pid=127626) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:46:32.024838 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e4b79c10-3fe5-40f2-9755-098f430ee7b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:32.025434 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e4b79c10-3fe5-40f2-9755-098f430ee7b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:32.034363 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4b79c10-3fe5-40f2-9755-098f430ee7b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.034693 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4b79c10-3fe5-40f2-9755-098f430ee7b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.035562 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4b79c10-3fe5-40f2-9755-098f430ee7b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.036855 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4b79c10-3fe5-40f2-9755-098f430ee7b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.037827 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4b79c10-3fe5-40f2-9755-098f430ee7b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.038829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4b79c10-3fe5-40f2-9755-098f430ee7b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.281155 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e4b79c10-3fe5-40f2-9755-098f430ee7b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:32.289126 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e4b79c10-3fe5-40f2-9755-098f430ee7b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.269686 Aug 24 16:46:32.289905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 147/276] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:32 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:32.381240 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-69ff91e8-b1dc-4736-b5c9-62313b51db37 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:32.387551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69ff91e8-b1dc-4736-b5c9-62313b51db37 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.388097 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69ff91e8-b1dc-4736-b5c9-62313b51db37 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.388608 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69ff91e8-b1dc-4736-b5c9-62313b51db37 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.431968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5a7d4379-ed9d-4ed6-b796-a168f590c826 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 204 len: 0 microversion: 2.1 time: 0.511499 Aug 24 16:46:32.432797 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 130/277] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:46:31 2022] DELETE /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:46:32.442066 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1e5db19e-df0e-441c-9540-d8d123de9a02 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:32.442947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1e5db19e-df0e-441c-9540-d8d123de9a02 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:32.446189 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:32.448911 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e5db19e-df0e-441c-9540-d8d123de9a02 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.449389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e5db19e-df0e-441c-9540-d8d123de9a02 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.449816 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e5db19e-df0e-441c-9540-d8d123de9a02 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.450527 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e5db19e-df0e-441c-9540-d8d123de9a02 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.450973 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e5db19e-df0e-441c-9540-d8d123de9a02 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.451392 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e5db19e-df0e-441c-9540-d8d123de9a02 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.452237 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-69ff91e8-b1dc-4736-b5c9-62313b51db37 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Going to try to stop instance {{(pid=127627) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 16:46:32.634363 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1e5db19e-df0e-441c-9540-d8d123de9a02 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:32.643064 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1e5db19e-df0e-441c-9540-d8d123de9a02 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1470 microversion: 2.1 time: 0.205884 Aug 24 16:46:32.643662 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 131/278] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:32 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1470 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:32.656527 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-01758f8a-b0be-4db6-b88d-8160e4168886 req-fd8b36a6-3ab5-4b97-8813-44da3f2c4baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4", "tag": "8f12eb4e-a077-4950-8f49-746c7b5d2410"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:32.660138 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-01758f8a-b0be-4db6-b88d-8160e4168886 req-fd8b36a6-3ab5-4b97-8813-44da3f2c4baf service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.660656 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-01758f8a-b0be-4db6-b88d-8160e4168886 req-fd8b36a6-3ab5-4b97-8813-44da3f2c4baf service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.661102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-01758f8a-b0be-4db6-b88d-8160e4168886 req-fd8b36a6-3ab5-4b97-8813-44da3f2c4baf service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.669248 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-69ff91e8-b1dc-4736-b5c9-62313b51db37 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "POST /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/action" status: 202 len: 0 microversion: 2.1 time: 0.292024 Aug 24 16:46:32.669858 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 148/279] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:46:32 2022] POST /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 16:46:32.674337 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-01758f8a-b0be-4db6-b88d-8160e4168886 req-fd8b36a6-3ab5-4b97-8813-44da3f2c4baf service nova] Creating event network-changed:8f12eb4e-a077-4950-8f49-746c7b5d2410 for instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 on hv-cinder-73116 Aug 24 16:46:32.675681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f52e99d1-36c2-4aed-aa91-8243954756bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:32.676402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f52e99d1-36c2-4aed-aa91-8243954756bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:32.679205 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-01758f8a-b0be-4db6-b88d-8160e4168886 req-fd8b36a6-3ab5-4b97-8813-44da3f2c4baf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034300 Aug 24 16:46:32.679809 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 132/280] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:32.683131 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f52e99d1-36c2-4aed-aa91-8243954756bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.683798 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f52e99d1-36c2-4aed-aa91-8243954756bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.684383 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f52e99d1-36c2-4aed-aa91-8243954756bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.685276 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f52e99d1-36c2-4aed-aa91-8243954756bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.685402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-95d2fbce-64f4-4402-9e5b-50a569adadec tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:32.685882 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f52e99d1-36c2-4aed-aa91-8243954756bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.686016 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-95d2fbce-64f4-4402-9e5b-50a569adadec tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:32.686418 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f52e99d1-36c2-4aed-aa91-8243954756bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.695204 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95d2fbce-64f4-4402-9e5b-50a569adadec tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.695818 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95d2fbce-64f4-4402-9e5b-50a569adadec tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.696259 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95d2fbce-64f4-4402-9e5b-50a569adadec tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.697565 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95d2fbce-64f4-4402-9e5b-50a569adadec tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.698210 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95d2fbce-64f4-4402-9e5b-50a569adadec tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.698672 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95d2fbce-64f4-4402-9e5b-50a569adadec tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.901127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f52e99d1-36c2-4aed-aa91-8243954756bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:32.910146 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f52e99d1-36c2-4aed-aa91-8243954756bf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.239060 Aug 24 16:46:32.911009 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 149/281] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:32 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:32.925509 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-95d2fbce-64f4-4402-9e5b-50a569adadec tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:32.934426 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-95d2fbce-64f4-4402-9e5b-50a569adadec tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.253405 Aug 24 16:46:32.935315 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 133/282] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:32 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:33.313721 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c16cff90-e098-4dc1-9584-ff5442a93442 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:33.314352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c16cff90-e098-4dc1-9584-ff5442a93442 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:33.321788 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c16cff90-e098-4dc1-9584-ff5442a93442 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:33.322362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c16cff90-e098-4dc1-9584-ff5442a93442 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:33.322803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c16cff90-e098-4dc1-9584-ff5442a93442 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:33.323501 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c16cff90-e098-4dc1-9584-ff5442a93442 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:33.323951 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c16cff90-e098-4dc1-9584-ff5442a93442 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:33.324388 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c16cff90-e098-4dc1-9584-ff5442a93442 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:33.476152 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c16cff90-e098-4dc1-9584-ff5442a93442 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:33.484886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c16cff90-e098-4dc1-9584-ff5442a93442 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.175123 Aug 24 16:46:33.485503 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 150/283] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:33 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:33.668931 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-192e3767-ae43-414c-99bb-9775b783dd5f tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:33.669469 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-192e3767-ae43-414c-99bb-9775b783dd5f tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:33.676621 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-192e3767-ae43-414c-99bb-9775b783dd5f tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:33.677112 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-192e3767-ae43-414c-99bb-9775b783dd5f tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:33.677550 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-192e3767-ae43-414c-99bb-9775b783dd5f tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:33.678249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-192e3767-ae43-414c-99bb-9775b783dd5f tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:33.678706 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-192e3767-ae43-414c-99bb-9775b783dd5f tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:33.679133 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-192e3767-ae43-414c-99bb-9775b783dd5f tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:33.817897 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-192e3767-ae43-414c-99bb-9775b783dd5f tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:33.826356 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-192e3767-ae43-414c-99bb-9775b783dd5f tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1470 microversion: 2.1 time: 0.161245 Aug 24 16:46:33.827563 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 134/284] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:33 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:33.931265 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-64d406c7-7b70-4b9d-aa4a-6b9cac09c244 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:33.932002 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-64d406c7-7b70-4b9d-aa4a-6b9cac09c244 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:33.939798 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d406c7-7b70-4b9d-aa4a-6b9cac09c244 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:33.940291 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d406c7-7b70-4b9d-aa4a-6b9cac09c244 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:33.940792 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d406c7-7b70-4b9d-aa4a-6b9cac09c244 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:33.941499 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d406c7-7b70-4b9d-aa4a-6b9cac09c244 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:33.941951 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d406c7-7b70-4b9d-aa4a-6b9cac09c244 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:33.942430 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-64d406c7-7b70-4b9d-aa4a-6b9cac09c244 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:33.957976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-14a698fb-f394-42dd-8e1a-e964d8f41be3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:33.958593 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-14a698fb-f394-42dd-8e1a-e964d8f41be3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:33.965275 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14a698fb-f394-42dd-8e1a-e964d8f41be3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:33.965912 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14a698fb-f394-42dd-8e1a-e964d8f41be3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:33.966662 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14a698fb-f394-42dd-8e1a-e964d8f41be3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:33.967380 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14a698fb-f394-42dd-8e1a-e964d8f41be3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:33.967876 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14a698fb-f394-42dd-8e1a-e964d8f41be3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:33.968471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14a698fb-f394-42dd-8e1a-e964d8f41be3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:34.167216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-64d406c7-7b70-4b9d-aa4a-6b9cac09c244 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:34.170702 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-14a698fb-f394-42dd-8e1a-e964d8f41be3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:34.178852 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-64d406c7-7b70-4b9d-aa4a-6b9cac09c244 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.251405 Aug 24 16:46:34.179437 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 151/285] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:33 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:34.180152 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-14a698fb-f394-42dd-8e1a-e964d8f41be3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.225841 Aug 24 16:46:34.180789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 135/286] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:33 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:34.507112 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a6ee61e2-20e5-4615-ae34-7b918fbab80a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:34.507923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a6ee61e2-20e5-4615-ae34-7b918fbab80a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:34.515125 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6ee61e2-20e5-4615-ae34-7b918fbab80a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:34.515686 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6ee61e2-20e5-4615-ae34-7b918fbab80a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:34.516500 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6ee61e2-20e5-4615-ae34-7b918fbab80a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:34.517246 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6ee61e2-20e5-4615-ae34-7b918fbab80a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:34.517705 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6ee61e2-20e5-4615-ae34-7b918fbab80a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:34.518128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6ee61e2-20e5-4615-ae34-7b918fbab80a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:34.658187 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a6ee61e2-20e5-4615-ae34-7b918fbab80a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:34.666500 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a6ee61e2-20e5-4615-ae34-7b918fbab80a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.163564 Aug 24 16:46:34.667080 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 152/287] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:34 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:34.847141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6b704d00-e4b2-4c60-bf0b-6a64eb4ce6cb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:34.847840 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6b704d00-e4b2-4c60-bf0b-6a64eb4ce6cb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:34.849680 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:34.854986 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b704d00-e4b2-4c60-bf0b-6a64eb4ce6cb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:34.855469 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b704d00-e4b2-4c60-bf0b-6a64eb4ce6cb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:34.855899 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b704d00-e4b2-4c60-bf0b-6a64eb4ce6cb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:34.856614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b704d00-e4b2-4c60-bf0b-6a64eb4ce6cb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:34.857066 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b704d00-e4b2-4c60-bf0b-6a64eb4ce6cb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:34.857898 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b704d00-e4b2-4c60-bf0b-6a64eb4ce6cb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.001361 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-6b704d00-e4b2-4c60-bf0b-6a64eb4ce6cb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:35.009746 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6b704d00-e4b2-4c60-bf0b-6a64eb4ce6cb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1470 microversion: 2.1 time: 0.166388 Aug 24 16:46:35.010330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 136/288] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:34 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:35.200779 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7c65fcbd-f423-4fa6-ba1a-d4caaa832ad6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:35.203884 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7c65fcbd-f423-4fa6-ba1a-d4caaa832ad6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:35.204050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-af3e55cc-d0ba-4e52-a639-dd00a4a4a069 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:35.204050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-af3e55cc-d0ba-4e52-a639-dd00a4a4a069 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:35.207810 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c65fcbd-f423-4fa6-ba1a-d4caaa832ad6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:35.210162 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c65fcbd-f423-4fa6-ba1a-d4caaa832ad6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:35.210162 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c65fcbd-f423-4fa6-ba1a-d4caaa832ad6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.210162 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c65fcbd-f423-4fa6-ba1a-d4caaa832ad6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:35.210162 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c65fcbd-f423-4fa6-ba1a-d4caaa832ad6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:35.210557 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c65fcbd-f423-4fa6-ba1a-d4caaa832ad6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.212446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af3e55cc-d0ba-4e52-a639-dd00a4a4a069 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:35.213048 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af3e55cc-d0ba-4e52-a639-dd00a4a4a069 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:35.213603 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af3e55cc-d0ba-4e52-a639-dd00a4a4a069 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.214281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af3e55cc-d0ba-4e52-a639-dd00a4a4a069 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:35.214731 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af3e55cc-d0ba-4e52-a639-dd00a4a4a069 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:35.215149 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af3e55cc-d0ba-4e52-a639-dd00a4a4a069 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.427867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7c65fcbd-f423-4fa6-ba1a-d4caaa832ad6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:35.434743 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-af3e55cc-d0ba-4e52-a639-dd00a4a4a069 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:35.440127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7c65fcbd-f423-4fa6-ba1a-d4caaa832ad6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.243058 Aug 24 16:46:35.441395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 153/289] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:35 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:35.444281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-af3e55cc-d0ba-4e52-a639-dd00a4a4a069 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.246266 Aug 24 16:46:35.444935 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 137/290] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:35 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:35.688123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4faf8449-a079-4546-aa96-a7f4c330c457 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:35.688669 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4faf8449-a079-4546-aa96-a7f4c330c457 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:35.695427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4faf8449-a079-4546-aa96-a7f4c330c457 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:35.695914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4faf8449-a079-4546-aa96-a7f4c330c457 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:35.696365 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4faf8449-a079-4546-aa96-a7f4c330c457 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.697075 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4faf8449-a079-4546-aa96-a7f4c330c457 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:35.697532 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4faf8449-a079-4546-aa96-a7f4c330c457 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:35.697971 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4faf8449-a079-4546-aa96-a7f4c330c457 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.844784 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4faf8449-a079-4546-aa96-a7f4c330c457 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:35.852775 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4faf8449-a079-4546-aa96-a7f4c330c457 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.169521 Aug 24 16:46:35.853342 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 154/291] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:35 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:36.033257 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-bb0db0ca-fd2d-4f4c-b0fb-23903721f4bb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:36.033865 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-bb0db0ca-fd2d-4f4c-b0fb-23903721f4bb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:36.040269 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb0db0ca-fd2d-4f4c-b0fb-23903721f4bb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.040789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb0db0ca-fd2d-4f4c-b0fb-23903721f4bb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.041252 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb0db0ca-fd2d-4f4c-b0fb-23903721f4bb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:36.041940 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb0db0ca-fd2d-4f4c-b0fb-23903721f4bb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.042395 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb0db0ca-fd2d-4f4c-b0fb-23903721f4bb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.042831 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb0db0ca-fd2d-4f4c-b0fb-23903721f4bb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:36.180382 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-bb0db0ca-fd2d-4f4c-b0fb-23903721f4bb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:36.190672 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-bb0db0ca-fd2d-4f4c-b0fb-23903721f4bb tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1470 microversion: 2.1 time: 0.161324 Aug 24 16:46:36.194742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 138/292] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:36 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:36.462053 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ebec880c-a8a1-48e7-81b8-36c6d4faeb12 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:36.462604 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ebec880c-a8a1-48e7-81b8-36c6d4faeb12 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:36.464618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:36.477135 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=20 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:36.477332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d57900f4-09e0-4bf9-8d1e-5546698debf2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:36.477332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d57900f4-09e0-4bf9-8d1e-5546698debf2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:36.477553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebec880c-a8a1-48e7-81b8-36c6d4faeb12 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.477553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebec880c-a8a1-48e7-81b8-36c6d4faeb12 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.477553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebec880c-a8a1-48e7-81b8-36c6d4faeb12 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:36.477553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebec880c-a8a1-48e7-81b8-36c6d4faeb12 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.477860 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebec880c-a8a1-48e7-81b8-36c6d4faeb12 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.477860 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebec880c-a8a1-48e7-81b8-36c6d4faeb12 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:36.479888 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d57900f4-09e0-4bf9-8d1e-5546698debf2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.480685 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d57900f4-09e0-4bf9-8d1e-5546698debf2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.481502 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d57900f4-09e0-4bf9-8d1e-5546698debf2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:36.482455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d57900f4-09e0-4bf9-8d1e-5546698debf2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.483971 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d57900f4-09e0-4bf9-8d1e-5546698debf2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.484650 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d57900f4-09e0-4bf9-8d1e-5546698debf2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:36.590163 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=12 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:36.756272 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ebec880c-a8a1-48e7-81b8-36c6d4faeb12 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:36.760570 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d57900f4-09e0-4bf9-8d1e-5546698debf2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:36.766590 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ebec880c-a8a1-48e7-81b8-36c6d4faeb12 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.308313 Aug 24 16:46:36.767366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 155/293] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:36 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:36.771253 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d57900f4-09e0-4bf9-8d1e-5546698debf2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.304003 Aug 24 16:46:36.771842 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 139/294] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:36 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:36.874204 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2dc07832-b895-46da-93c6-0b9d59f65843 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:36.874927 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2dc07832-b895-46da-93c6-0b9d59f65843 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:36.882071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dc07832-b895-46da-93c6-0b9d59f65843 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.882558 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dc07832-b895-46da-93c6-0b9d59f65843 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.883290 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dc07832-b895-46da-93c6-0b9d59f65843 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:36.883996 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dc07832-b895-46da-93c6-0b9d59f65843 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.884476 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dc07832-b895-46da-93c6-0b9d59f65843 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.884915 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dc07832-b895-46da-93c6-0b9d59f65843 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:37.034520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2dc07832-b895-46da-93c6-0b9d59f65843 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:37.048666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2dc07832-b895-46da-93c6-0b9d59f65843 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.177840 Aug 24 16:46:37.049703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 156/295] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:36 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:37.216777 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f4ebd586-e808-4bf9-beaf-9eca79bafbf8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:37.218058 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f4ebd586-e808-4bf9-beaf-9eca79bafbf8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:37.224564 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f4ebd586-e808-4bf9-beaf-9eca79bafbf8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:37.225118 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f4ebd586-e808-4bf9-beaf-9eca79bafbf8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:37.225692 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f4ebd586-e808-4bf9-beaf-9eca79bafbf8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:37.226593 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f4ebd586-e808-4bf9-beaf-9eca79bafbf8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:37.227055 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f4ebd586-e808-4bf9-beaf-9eca79bafbf8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:37.227479 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f4ebd586-e808-4bf9-beaf-9eca79bafbf8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:37.387744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f4ebd586-e808-4bf9-beaf-9eca79bafbf8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:37.396724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f4ebd586-e808-4bf9-beaf-9eca79bafbf8 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1470 microversion: 2.1 time: 0.183563 Aug 24 16:46:37.397346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 140/296] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:37 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1470 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:37.789719 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dd069d00-5eda-4d94-9791-2c724999109e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:37.790224 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-dd069d00-5eda-4d94-9791-2c724999109e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:37.793436 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2cc46764-011c-4d8c-b76d-9f628b830181 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:37.793683 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2cc46764-011c-4d8c-b76d-9f628b830181 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:37.797465 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd069d00-5eda-4d94-9791-2c724999109e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:37.797979 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd069d00-5eda-4d94-9791-2c724999109e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:37.798410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd069d00-5eda-4d94-9791-2c724999109e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:37.799324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd069d00-5eda-4d94-9791-2c724999109e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:37.799784 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd069d00-5eda-4d94-9791-2c724999109e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:37.800131 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2cc46764-011c-4d8c-b76d-9f628b830181 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:37.800281 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd069d00-5eda-4d94-9791-2c724999109e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:37.800466 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2cc46764-011c-4d8c-b76d-9f628b830181 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:37.800806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2cc46764-011c-4d8c-b76d-9f628b830181 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:37.801537 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2cc46764-011c-4d8c-b76d-9f628b830181 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:37.801994 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2cc46764-011c-4d8c-b76d-9f628b830181 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:37.802424 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2cc46764-011c-4d8c-b76d-9f628b830181 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:38.022973 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-dd069d00-5eda-4d94-9791-2c724999109e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:38.028096 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2cc46764-011c-4d8c-b76d-9f628b830181 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:38.044326 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-dd069d00-5eda-4d94-9791-2c724999109e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.258953 Aug 24 16:46:38.044933 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 157/297] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:37 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:38.046068 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2cc46764-011c-4d8c-b76d-9f628b830181 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.255049 Aug 24 16:46:38.047169 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 141/298] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:37 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:38.069597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8e9b2e0e-de31-466a-9054-d1b69b496a70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:38.070208 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8e9b2e0e-de31-466a-9054-d1b69b496a70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:38.079987 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8e9b2e0e-de31-466a-9054-d1b69b496a70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:38.080520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8e9b2e0e-de31-466a-9054-d1b69b496a70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:38.081413 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8e9b2e0e-de31-466a-9054-d1b69b496a70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:38.082598 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8e9b2e0e-de31-466a-9054-d1b69b496a70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:38.083032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8e9b2e0e-de31-466a-9054-d1b69b496a70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:38.083520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8e9b2e0e-de31-466a-9054-d1b69b496a70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:38.365159 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8e9b2e0e-de31-466a-9054-d1b69b496a70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:38.373391 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8e9b2e0e-de31-466a-9054-d1b69b496a70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.307730 Aug 24 16:46:38.387740 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 158/299] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:38 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:38.418771 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7f91b11b-e25d-4e13-9666-71ef53663e47 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:38.426332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7f91b11b-e25d-4e13-9666-71ef53663e47 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:38.426707 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f91b11b-e25d-4e13-9666-71ef53663e47 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:38.427189 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f91b11b-e25d-4e13-9666-71ef53663e47 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:38.427832 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f91b11b-e25d-4e13-9666-71ef53663e47 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:38.428724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f91b11b-e25d-4e13-9666-71ef53663e47 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:38.429351 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f91b11b-e25d-4e13-9666-71ef53663e47 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:38.429932 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f91b11b-e25d-4e13-9666-71ef53663e47 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:38.713806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7f91b11b-e25d-4e13-9666-71ef53663e47 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:38.726852 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7f91b11b-e25d-4e13-9666-71ef53663e47 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1470 microversion: 2.1 time: 0.311885 Aug 24 16:46:38.732381 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 142/300] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:38 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1470 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:39.067847 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2fe0e550-02b5-4e27-b09a-7f7c04da194c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:39.069163 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2fe0e550-02b5-4e27-b09a-7f7c04da194c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:39.071302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:39.074722 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6dd5d417-0d86-4451-b4cc-e51819db3a33 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:39.075698 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6dd5d417-0d86-4451-b4cc-e51819db3a33 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:39.076951 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fe0e550-02b5-4e27-b09a-7f7c04da194c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:39.077490 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fe0e550-02b5-4e27-b09a-7f7c04da194c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:39.077929 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fe0e550-02b5-4e27-b09a-7f7c04da194c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:39.078647 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fe0e550-02b5-4e27-b09a-7f7c04da194c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:39.079095 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fe0e550-02b5-4e27-b09a-7f7c04da194c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:39.079610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fe0e550-02b5-4e27-b09a-7f7c04da194c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:39.086731 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6dd5d417-0d86-4451-b4cc-e51819db3a33 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:39.088459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6dd5d417-0d86-4451-b4cc-e51819db3a33 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:39.089145 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6dd5d417-0d86-4451-b4cc-e51819db3a33 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:39.091877 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6dd5d417-0d86-4451-b4cc-e51819db3a33 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:39.098510 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6dd5d417-0d86-4451-b4cc-e51819db3a33 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:39.098510 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6dd5d417-0d86-4451-b4cc-e51819db3a33 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:39.536843 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2fe0e550-02b5-4e27-b09a-7f7c04da194c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:39.549202 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2fe0e550-02b5-4e27-b09a-7f7c04da194c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.486876 Aug 24 16:46:39.550372 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 159/301] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:39 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:39.555559 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-6dd5d417-0d86-4451-b4cc-e51819db3a33 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:39.556189 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-ef84f996-faea-461b-acd2-0dd507d2bc28 req-af7fad5c-f2fa-44c6-82f7-45704a24f80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba54a89-d4d3-4d77-aa35-bf744968c331", "name": "network-vif-deleted", "tag": "b4a6135d-99c4-4c1b-bbe4-97294bfe7cfb"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:39.568032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ef84f996-faea-461b-acd2-0dd507d2bc28 req-af7fad5c-f2fa-44c6-82f7-45704a24f80a service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:39.568696 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ef84f996-faea-461b-acd2-0dd507d2bc28 req-af7fad5c-f2fa-44c6-82f7-45704a24f80a service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:39.569442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ef84f996-faea-461b-acd2-0dd507d2bc28 req-af7fad5c-f2fa-44c6-82f7-45704a24f80a service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:39.577692 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6dd5d417-0d86-4451-b4cc-e51819db3a33 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.506580 Aug 24 16:46:39.585047 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-ef84f996-faea-461b-acd2-0dd507d2bc28 req-af7fad5c-f2fa-44c6-82f7-45704a24f80a service nova] Creating event network-vif-deleted:b4a6135d-99c4-4c1b-bbe4-97294bfe7cfb for instance 7ba54a89-d4d3-4d77-aa35-bf744968c331 on hv-cinder-73116 Aug 24 16:46:39.589122 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 143/302] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:39 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:39.594493 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d86ef13f-dbad-4cdd-aead-8561cd775c63 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:39.595388 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d86ef13f-dbad-4cdd-aead-8561cd775c63 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:39.603896 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d86ef13f-dbad-4cdd-aead-8561cd775c63 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:39.606010 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-ef84f996-faea-461b-acd2-0dd507d2bc28 req-af7fad5c-f2fa-44c6-82f7-45704a24f80a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054165 Aug 24 16:46:39.606795 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d86ef13f-dbad-4cdd-aead-8561cd775c63 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:39.614015 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 160/303] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:39.614861 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d86ef13f-dbad-4cdd-aead-8561cd775c63 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:39.614861 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d86ef13f-dbad-4cdd-aead-8561cd775c63 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:39.614861 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d86ef13f-dbad-4cdd-aead-8561cd775c63 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:39.614861 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d86ef13f-dbad-4cdd-aead-8561cd775c63 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:39.755291 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:39.756246 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:39.767195 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:39.768485 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:39.769443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:39.771797 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:39.772578 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:39.773211 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:39.813202 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:39.813904 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:39.814576 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:39.815324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lazy-loading 'fault' on Instance uuid 7ba54a89-d4d3-4d77-aa35-bf744968c331 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:46:39.819690 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d86ef13f-dbad-4cdd-aead-8561cd775c63 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:39.835227 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d86ef13f-dbad-4cdd-aead-8561cd775c63 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.244713 Aug 24 16:46:39.837557 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 144/304] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:39 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:39.878505 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-e21bd102-ebe2-41b5-bd24-fb92cb190d4f req-39bca4d3-db8d-4eaf-8bec-cbdc3035a7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e8d907-5a6d-450e-92bc-a4ee16bde539", "name": "network-vif-plugged", "status": "completed", "tag": "d972466c-37b3-4485-ba2b-6a1659a3de80"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:39.889623 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-e21bd102-ebe2-41b5-bd24-fb92cb190d4f req-39bca4d3-db8d-4eaf-8bec-cbdc3035a7ce service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:39.890132 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-e21bd102-ebe2-41b5-bd24-fb92cb190d4f req-39bca4d3-db8d-4eaf-8bec-cbdc3035a7ce service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:39.890603 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-e21bd102-ebe2-41b5-bd24-fb92cb190d4f req-39bca4d3-db8d-4eaf-8bec-cbdc3035a7ce service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:39.894958 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:39.901385 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:39.903456 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-e21bd102-ebe2-41b5-bd24-fb92cb190d4f req-39bca4d3-db8d-4eaf-8bec-cbdc3035a7ce service nova] Creating event network-vif-plugged:d972466c-37b3-4485-ba2b-6a1659a3de80 for instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 on hv-cinder-73116 Aug 24 16:46:39.909471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-e21bd102-ebe2-41b5-bd24-fb92cb190d4f req-39bca4d3-db8d-4eaf-8bec-cbdc3035a7ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036164 Aug 24 16:46:39.910187 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 145/305] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:46:39.910364 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-91982e5b-1969-4dcb-bd2f-ee7ee2649879 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1305 microversion: 2.1 time: 0.159823 Aug 24 16:46:39.913003 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 161/306] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:39 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1305 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:40.572156 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f891f9b0-6e31-4e49-bb67-2ba87d2623e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:40.572888 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f891f9b0-6e31-4e49-bb67-2ba87d2623e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:40.580674 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f891f9b0-6e31-4e49-bb67-2ba87d2623e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:40.581293 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f891f9b0-6e31-4e49-bb67-2ba87d2623e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:40.581747 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f891f9b0-6e31-4e49-bb67-2ba87d2623e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:40.582503 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f891f9b0-6e31-4e49-bb67-2ba87d2623e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:40.582955 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f891f9b0-6e31-4e49-bb67-2ba87d2623e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:40.583384 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f891f9b0-6e31-4e49-bb67-2ba87d2623e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:40.611371 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bea80995-4b2a-4e62-9530-e1fdbc550aea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:40.612185 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bea80995-4b2a-4e62-9530-e1fdbc550aea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:40.618985 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bea80995-4b2a-4e62-9530-e1fdbc550aea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:40.619466 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bea80995-4b2a-4e62-9530-e1fdbc550aea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:40.620050 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bea80995-4b2a-4e62-9530-e1fdbc550aea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:40.620772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bea80995-4b2a-4e62-9530-e1fdbc550aea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:40.621220 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bea80995-4b2a-4e62-9530-e1fdbc550aea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:40.621636 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bea80995-4b2a-4e62-9530-e1fdbc550aea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:40.801415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f891f9b0-6e31-4e49-bb67-2ba87d2623e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:40.812755 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f891f9b0-6e31-4e49-bb67-2ba87d2623e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.244891 Aug 24 16:46:40.813630 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 146/307] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:40 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:40.818339 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bea80995-4b2a-4e62-9530-e1fdbc550aea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:40.828189 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bea80995-4b2a-4e62-9530-e1fdbc550aea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.221057 Aug 24 16:46:40.829352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 162/308] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:40 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:40.859853 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-370cd1c8-0b41-45ec-b66b-32cb965f2b07 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:40.860509 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-370cd1c8-0b41-45ec-b66b-32cb965f2b07 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:40.866859 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-370cd1c8-0b41-45ec-b66b-32cb965f2b07 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:40.867337 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-370cd1c8-0b41-45ec-b66b-32cb965f2b07 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:40.867771 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-370cd1c8-0b41-45ec-b66b-32cb965f2b07 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:40.868531 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-370cd1c8-0b41-45ec-b66b-32cb965f2b07 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:40.868991 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-370cd1c8-0b41-45ec-b66b-32cb965f2b07 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:40.869416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-370cd1c8-0b41-45ec-b66b-32cb965f2b07 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:40.933764 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:40.934689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:40.941244 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:40.942029 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:40.942557 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:40.943367 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:40.943918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:40.945179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:40.979227 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:40.979227 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:40.980441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:40.980441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lazy-loading 'fault' on Instance uuid 7ba54a89-d4d3-4d77-aa35-bf744968c331 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:46:41.029103 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec16281c5cfd4c2a90b12c097c0a3e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd583b569f04997b2ee33b74110ea25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:41.038309 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c1d61675-6f7b-4d41-a3ec-0d3d73c6d239 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 200 len: 1305 microversion: 2.1 time: 0.108680 Aug 24 16:46:41.038882 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 163/309] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:40 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:41.056728 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-370cd1c8-0b41-45ec-b66b-32cb965f2b07 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:41.064648 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-370cd1c8-0b41-45ec-b66b-32cb965f2b07 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.209814 Aug 24 16:46:41.065209 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 147/310] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:40 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:41.840828 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0ba43b00-55dc-4375-aa00-fc05877e8c45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:41.841511 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0ba43b00-55dc-4375-aa00-fc05877e8c45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:41.848956 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ba43b00-55dc-4375-aa00-fc05877e8c45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:41.849437 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ba43b00-55dc-4375-aa00-fc05877e8c45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:41.849864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ba43b00-55dc-4375-aa00-fc05877e8c45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:41.850549 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ba43b00-55dc-4375-aa00-fc05877e8c45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:41.850994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ba43b00-55dc-4375-aa00-fc05877e8c45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:41.851286 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-737d54d6-d5c3-4e01-a88e-f546428d6ccf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:41.851709 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ba43b00-55dc-4375-aa00-fc05877e8c45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:41.851899 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-737d54d6-d5c3-4e01-a88e-f546428d6ccf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:41.855589 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:41.858896 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-737d54d6-d5c3-4e01-a88e-f546428d6ccf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:41.859379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-737d54d6-d5c3-4e01-a88e-f546428d6ccf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:41.859822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-737d54d6-d5c3-4e01-a88e-f546428d6ccf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:41.860545 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-737d54d6-d5c3-4e01-a88e-f546428d6ccf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:41.861003 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-737d54d6-d5c3-4e01-a88e-f546428d6ccf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:41.861463 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-737d54d6-d5c3-4e01-a88e-f546428d6ccf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:42.071780 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0ba43b00-55dc-4375-aa00-fc05877e8c45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:42.074629 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-737d54d6-d5c3-4e01-a88e-f546428d6ccf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:42.083488 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0ba43b00-55dc-4375-aa00-fc05877e8c45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.246647 Aug 24 16:46:42.084035 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 164/311] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:41 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:42.084577 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-737d54d6-d5c3-4e01-a88e-f546428d6ccf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.237247 Aug 24 16:46:42.085698 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 148/312] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:41 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:42.089165 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:42.090000 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] [instance: 7ba54a89-d4d3-4d77-aa35-bf744968c331] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:42.091027 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-97b563cd-25c3-4150-910e-9bb6b9f25af4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:42.091835 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-97b563cd-25c3-4150-910e-9bb6b9f25af4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:42.100432 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97b563cd-25c3-4150-910e-9bb6b9f25af4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:42.101002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97b563cd-25c3-4150-910e-9bb6b9f25af4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:42.101651 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97b563cd-25c3-4150-910e-9bb6b9f25af4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:42.101740 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:42.102107 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:42.102521 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97b563cd-25c3-4150-910e-9bb6b9f25af4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:42.102830 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:42.103202 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97b563cd-25c3-4150-910e-9bb6b9f25af4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:42.103686 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-97b563cd-25c3-4150-910e-9bb6b9f25af4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:42.103783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:42.104494 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:42.104923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:42.126647 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] HTTP exception thrown: Instance 7ba54a89-d4d3-4d77-aa35-bf744968c331 could not be found. Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Request method failure captured: Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 HTTP/1.1 Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlXRUfs3nmBnRq44lKl0-1VLJ9xToiZfhgyKTxVqDy7ZQdRIOtSc5Y7tqXJ5No8bAHqrv4tHfAAFLoaXpyHNxQ9_bYMs6s50WunnKIi5z_t0KOMsnMpJ3WAF6BxfaH0U7i0cezjjb3r3XmPxuUzLDoF45FSFZvy4cy1FPWnscwFFMf8 Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: bbd583b569f04997b2ee33b74110ea25 Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesNegativeTest-1330351436 Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:46:42.128854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bbd583b569f04997b2ee33b74110ea25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd583b569f04997b2ee33b74110ea25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bbd583b569f04997b2ee33b74110ea25", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bbd583b569f04997b2ee33b74110ea25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesNegativeTest-1330351436 Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: bbd583b569f04997b2ee33b74110ea25 Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesNegativeTest-1330351436 Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesNegativeTest-1330351436-project Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: ec16281c5cfd4c2a90b12c097c0a3e0a Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesNegativeTest-1330351436-project Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 7ba54a89-d4d3-4d77-aa35-bf744968c331 could not be found. Aug 24 16:46:42.130166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '7ba54a89-d4d3-4d77-aa35-bf744968c331'} Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba54a89-d4d3-4d77-aa35-bf744968c331 could not be found. Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:46:42.130886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba54a89-d4d3-4d77-aa35-bf744968c331 could not be found. Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba54a89-d4d3-4d77-aa35-bf744968c331 could not be found. Aug 24 16:46:42.132110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:46:42.134442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] Returning 404 to user: Instance 7ba54a89-d4d3-4d77-aa35-bf744968c331 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:46:42.134442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c09e73f0-fa6b-4c16-b856-07d37c4b80d7 tempest-VolumesNegativeTest-1330351436 tempest-VolumesNegativeTest-1330351436-project] 10.222.0.17 "GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331" status: 404 len: 111 microversion: 2.1 time: 0.045245 Aug 24 16:46:42.134442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 165/313] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:42 2022] GET /compute/v2.1/servers/7ba54a89-d4d3-4d77-aa35-bf744968c331 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:46:42.256756 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-97b563cd-25c3-4150-910e-9bb6b9f25af4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:42.270348 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-97b563cd-25c3-4150-910e-9bb6b9f25af4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1371 microversion: 2.1 time: 0.183340 Aug 24 16:46:42.271058 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 149/314] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:42 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:43.107011 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-60e401be-682c-4f33-8dd6-38fc07e4fcd4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:43.108321 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-60e401be-682c-4f33-8dd6-38fc07e4fcd4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:43.109492 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-60f02e7c-3dab-43d2-b1c4-ee5b8ebc2abd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:43.110652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-60f02e7c-3dab-43d2-b1c4-ee5b8ebc2abd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:43.116005 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60e401be-682c-4f33-8dd6-38fc07e4fcd4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:43.116544 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60e401be-682c-4f33-8dd6-38fc07e4fcd4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:43.116976 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60e401be-682c-4f33-8dd6-38fc07e4fcd4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:43.117688 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60e401be-682c-4f33-8dd6-38fc07e4fcd4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:43.118142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60e401be-682c-4f33-8dd6-38fc07e4fcd4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:43.118566 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60e401be-682c-4f33-8dd6-38fc07e4fcd4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:43.119137 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-60f02e7c-3dab-43d2-b1c4-ee5b8ebc2abd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:43.119625 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-60f02e7c-3dab-43d2-b1c4-ee5b8ebc2abd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:43.120055 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-60f02e7c-3dab-43d2-b1c4-ee5b8ebc2abd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:43.120770 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-60f02e7c-3dab-43d2-b1c4-ee5b8ebc2abd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:43.121220 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-60f02e7c-3dab-43d2-b1c4-ee5b8ebc2abd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:43.125123 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-60f02e7c-3dab-43d2-b1c4-ee5b8ebc2abd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:43.380331 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-60f02e7c-3dab-43d2-b1c4-ee5b8ebc2abd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:43.384245 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-60e401be-682c-4f33-8dd6-38fc07e4fcd4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:43.390817 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-60f02e7c-3dab-43d2-b1c4-ee5b8ebc2abd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.287394 Aug 24 16:46:43.391588 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 150/315] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:43 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:43.405004 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-60e401be-682c-4f33-8dd6-38fc07e4fcd4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.290201 Aug 24 16:46:43.405004 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 166/316] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:43 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:43.422858 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9458df54-5fbf-42b9-b316-29344b439b92 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:43.422858 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9458df54-5fbf-42b9-b316-29344b439b92 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:43.425837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9458df54-5fbf-42b9-b316-29344b439b92 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:43.426328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9458df54-5fbf-42b9-b316-29344b439b92 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:43.427035 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9458df54-5fbf-42b9-b316-29344b439b92 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:43.427742 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9458df54-5fbf-42b9-b316-29344b439b92 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:43.428214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9458df54-5fbf-42b9-b316-29344b439b92 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:43.428623 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9458df54-5fbf-42b9-b316-29344b439b92 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:43.581292 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9458df54-5fbf-42b9-b316-29344b439b92 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:43.589471 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9458df54-5fbf-42b9-b316-29344b439b92 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1566 microversion: 2.1 time: 0.194604 Aug 24 16:46:43.591126 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 167/317] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:43 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:43.613745 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-33a67534-c02c-46ab-be61-fb81d7dd3044 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:43.614936 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-33a67534-c02c-46ab-be61-fb81d7dd3044 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:43.617141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:43.623836 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33a67534-c02c-46ab-be61-fb81d7dd3044 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:43.623836 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33a67534-c02c-46ab-be61-fb81d7dd3044 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:43.625493 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33a67534-c02c-46ab-be61-fb81d7dd3044 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:43.626690 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33a67534-c02c-46ab-be61-fb81d7dd3044 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:43.628428 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33a67534-c02c-46ab-be61-fb81d7dd3044 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:43.629036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-33a67534-c02c-46ab-be61-fb81d7dd3044 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:43.730961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-33a67534-c02c-46ab-be61-fb81d7dd3044 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121174 Aug 24 16:46:43.731534 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 151/318] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 16:46:43 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:44.423120 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-99417fcb-fd74-490e-97aa-e9ded27edb0c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:44.424145 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-99417fcb-fd74-490e-97aa-e9ded27edb0c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:44.427091 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8cb34973-dccd-4122-9258-e98c443e909b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:44.428217 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8cb34973-dccd-4122-9258-e98c443e909b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:44.439516 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cb34973-dccd-4122-9258-e98c443e909b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:44.440293 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cb34973-dccd-4122-9258-e98c443e909b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:44.441025 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cb34973-dccd-4122-9258-e98c443e909b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:44.442206 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cb34973-dccd-4122-9258-e98c443e909b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:44.442974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cb34973-dccd-4122-9258-e98c443e909b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:44.443705 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cb34973-dccd-4122-9258-e98c443e909b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:44.447537 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99417fcb-fd74-490e-97aa-e9ded27edb0c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:44.448558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99417fcb-fd74-490e-97aa-e9ded27edb0c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:44.449157 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99417fcb-fd74-490e-97aa-e9ded27edb0c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:44.453435 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99417fcb-fd74-490e-97aa-e9ded27edb0c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:44.453946 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99417fcb-fd74-490e-97aa-e9ded27edb0c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:44.454597 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99417fcb-fd74-490e-97aa-e9ded27edb0c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:44.803836 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-99417fcb-fd74-490e-97aa-e9ded27edb0c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:44.811493 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8cb34973-dccd-4122-9258-e98c443e909b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:44.817144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-99417fcb-fd74-490e-97aa-e9ded27edb0c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.400771 Aug 24 16:46:44.817738 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 152/319] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:44 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:44.822689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8cb34973-dccd-4122-9258-e98c443e909b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.408722 Aug 24 16:46:44.823478 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 168/320] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:44 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:45.045652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-89909d43-82ba-4ce1-b116-c5392b7503ce req-6f30f83e-0658-4034-b3be-88ef39d85aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e8d907-5a6d-450e-92bc-a4ee16bde539", "tag": "d972466c-37b3-4485-ba2b-6a1659a3de80"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:45.058372 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-89909d43-82ba-4ce1-b116-c5392b7503ce req-6f30f83e-0658-4034-b3be-88ef39d85aef service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:45.058853 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-89909d43-82ba-4ce1-b116-c5392b7503ce req-6f30f83e-0658-4034-b3be-88ef39d85aef service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:45.063661 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-89909d43-82ba-4ce1-b116-c5392b7503ce req-6f30f83e-0658-4034-b3be-88ef39d85aef service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:45.071858 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-89909d43-82ba-4ce1-b116-c5392b7503ce req-6f30f83e-0658-4034-b3be-88ef39d85aef service nova] Creating event network-changed:d972466c-37b3-4485-ba2b-6a1659a3de80 for instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 on hv-cinder-73116 Aug 24 16:46:45.077380 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-89909d43-82ba-4ce1-b116-c5392b7503ce req-6f30f83e-0658-4034-b3be-88ef39d85aef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038391 Aug 24 16:46:45.078085 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 153/321] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:45.855044 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2ae10e42-6d89-400e-ac43-1e5390ff34ac tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:45.855763 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2ae10e42-6d89-400e-ac43-1e5390ff34ac tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:45.862449 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9fe8df1a-cca8-49e4-8d37-75fc00182e31 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:45.863346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9fe8df1a-cca8-49e4-8d37-75fc00182e31 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:45.866412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ae10e42-6d89-400e-ac43-1e5390ff34ac tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:45.866962 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ae10e42-6d89-400e-ac43-1e5390ff34ac tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:45.867642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ae10e42-6d89-400e-ac43-1e5390ff34ac tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:45.868742 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ae10e42-6d89-400e-ac43-1e5390ff34ac tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:45.869132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ae10e42-6d89-400e-ac43-1e5390ff34ac tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:45.869773 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ae10e42-6d89-400e-ac43-1e5390ff34ac tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:45.870666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fe8df1a-cca8-49e4-8d37-75fc00182e31 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:45.876793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fe8df1a-cca8-49e4-8d37-75fc00182e31 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:45.876793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fe8df1a-cca8-49e4-8d37-75fc00182e31 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:45.876793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fe8df1a-cca8-49e4-8d37-75fc00182e31 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:45.876793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fe8df1a-cca8-49e4-8d37-75fc00182e31 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:45.877158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fe8df1a-cca8-49e4-8d37-75fc00182e31 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:46.262219 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9fe8df1a-cca8-49e4-8d37-75fc00182e31 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:46.276547 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9fe8df1a-cca8-49e4-8d37-75fc00182e31 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.418132 Aug 24 16:46:46.290053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 154/322] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:45 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:46.297232 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-37964f51-fed5-49dc-a241-88bd2a25ffba req-90bc6b35-345c-4dba-b51b-e6f5a9c4004d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4", "name": "network-vif-plugged", "status": "completed", "tag": "8f12eb4e-a077-4950-8f49-746c7b5d2410"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:46.300130 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2ae10e42-6d89-400e-ac43-1e5390ff34ac tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:46.314897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2ae10e42-6d89-400e-ac43-1e5390ff34ac tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.475432 Aug 24 16:46:46.315952 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 169/323] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:45 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:46.319226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-37964f51-fed5-49dc-a241-88bd2a25ffba req-90bc6b35-345c-4dba-b51b-e6f5a9c4004d service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:46.319791 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-37964f51-fed5-49dc-a241-88bd2a25ffba req-90bc6b35-345c-4dba-b51b-e6f5a9c4004d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:46.320295 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-37964f51-fed5-49dc-a241-88bd2a25ffba req-90bc6b35-345c-4dba-b51b-e6f5a9c4004d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:46.335218 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-37964f51-fed5-49dc-a241-88bd2a25ffba req-90bc6b35-345c-4dba-b51b-e6f5a9c4004d service nova] Creating event network-vif-plugged:8f12eb4e-a077-4950-8f49-746c7b5d2410 for instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 on hv-cinder-73116 Aug 24 16:46:46.343297 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-37964f51-fed5-49dc-a241-88bd2a25ffba req-90bc6b35-345c-4dba-b51b-e6f5a9c4004d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051604 Aug 24 16:46:46.343951 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 155/324] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:47.295137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1ab7085d-ad9d-4b58-9ead-a68fd18c28bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:47.296570 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1ab7085d-ad9d-4b58-9ead-a68fd18c28bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:47.303875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ab7085d-ad9d-4b58-9ead-a68fd18c28bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:47.304397 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ab7085d-ad9d-4b58-9ead-a68fd18c28bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:47.305013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ab7085d-ad9d-4b58-9ead-a68fd18c28bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:47.305726 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ab7085d-ad9d-4b58-9ead-a68fd18c28bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:47.306184 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ab7085d-ad9d-4b58-9ead-a68fd18c28bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:47.306604 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ab7085d-ad9d-4b58-9ead-a68fd18c28bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:47.338615 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9778b71e-4c63-442b-9190-28bae3dda249 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:47.339897 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9778b71e-4c63-442b-9190-28bae3dda249 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:47.348134 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9778b71e-4c63-442b-9190-28bae3dda249 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:47.348633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9778b71e-4c63-442b-9190-28bae3dda249 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:47.349073 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9778b71e-4c63-442b-9190-28bae3dda249 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:47.349962 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9778b71e-4c63-442b-9190-28bae3dda249 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:47.350426 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9778b71e-4c63-442b-9190-28bae3dda249 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:47.351035 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9778b71e-4c63-442b-9190-28bae3dda249 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:47.517569 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1ab7085d-ad9d-4b58-9ead-a68fd18c28bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:47.535779 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1ab7085d-ad9d-4b58-9ead-a68fd18c28bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.234453 Aug 24 16:46:47.535779 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 170/325] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:47 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:47.551059 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9778b71e-4c63-442b-9190-28bae3dda249 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:47.559383 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9778b71e-4c63-442b-9190-28bae3dda249 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.225756 Aug 24 16:46:47.559954 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 156/326] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:47 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:48.551755 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-da51b33f-f772-4e83-a1a4-eb3a58616cdb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:48.553267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-da51b33f-f772-4e83-a1a4-eb3a58616cdb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:48.563547 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da51b33f-f772-4e83-a1a4-eb3a58616cdb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:48.564215 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da51b33f-f772-4e83-a1a4-eb3a58616cdb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:48.564825 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da51b33f-f772-4e83-a1a4-eb3a58616cdb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:48.565648 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da51b33f-f772-4e83-a1a4-eb3a58616cdb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:48.566238 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da51b33f-f772-4e83-a1a4-eb3a58616cdb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:48.566724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da51b33f-f772-4e83-a1a4-eb3a58616cdb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:48.580883 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7446f316-81f8-4bf4-b03a-a1a87c011f98 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:48.581499 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7446f316-81f8-4bf4-b03a-a1a87c011f98 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:48.588561 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7446f316-81f8-4bf4-b03a-a1a87c011f98 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:48.589698 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7446f316-81f8-4bf4-b03a-a1a87c011f98 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:48.590186 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7446f316-81f8-4bf4-b03a-a1a87c011f98 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:48.590916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7446f316-81f8-4bf4-b03a-a1a87c011f98 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:48.591374 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7446f316-81f8-4bf4-b03a-a1a87c011f98 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:48.591803 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7446f316-81f8-4bf4-b03a-a1a87c011f98 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:48.811191 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-da51b33f-f772-4e83-a1a4-eb3a58616cdb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:48.815008 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7446f316-81f8-4bf4-b03a-a1a87c011f98 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:48.819314 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-da51b33f-f772-4e83-a1a4-eb3a58616cdb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1367 microversion: 2.1 time: 0.272486 Aug 24 16:46:48.819899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 171/327] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:48 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:48.824030 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7446f316-81f8-4bf4-b03a-a1a87c011f98 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.247122 Aug 24 16:46:48.824790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 157/328] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:48 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:49.470152 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2096757113", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1562779701", "security_groups": [{"name": "tempest-secgroup-smoke-406146474"}], "networks": [{"uuid": "6e759f09-8493-41a1-82dc-95cc3aa0aabe"}], "block_device_mapping_v2": [{"uuid": "904d0419-2a80-4ad2-acb7-4d42ab4211cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:49.601594 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] validate_networks() for [('6e759f09-8493-41a1-82dc-95cc3aa0aabe', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:46:49.840259 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-77c89089-d30b-4650-b847-8bada77ba6f9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:49.843509 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-77c89089-d30b-4650-b847-8bada77ba6f9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:49.850400 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-77c89089-d30b-4650-b847-8bada77ba6f9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:49.850971 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-77c89089-d30b-4650-b847-8bada77ba6f9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:49.851412 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-77c89089-d30b-4650-b847-8bada77ba6f9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:49.852112 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-77c89089-d30b-4650-b847-8bada77ba6f9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:49.852626 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-77c89089-d30b-4650-b847-8bada77ba6f9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:49.853047 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-77c89089-d30b-4650-b847-8bada77ba6f9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:50.089201 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-77c89089-d30b-4650-b847-8bada77ba6f9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:50.102588 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-77c89089-d30b-4650-b847-8bada77ba6f9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1557 microversion: 2.1 time: 0.266263 Aug 24 16:46:50.103449 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 158/329] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:49 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1557 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:50.109138 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8fc537e7-0a18-40d4-9120-344a53ac300f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:50.109739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8fc537e7-0a18-40d4-9120-344a53ac300f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:50.116667 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fc537e7-0a18-40d4-9120-344a53ac300f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:50.117494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fc537e7-0a18-40d4-9120-344a53ac300f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:50.118003 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fc537e7-0a18-40d4-9120-344a53ac300f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:50.119101 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fc537e7-0a18-40d4-9120-344a53ac300f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:50.126558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fc537e7-0a18-40d4-9120-344a53ac300f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:50.126558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fc537e7-0a18-40d4-9120-344a53ac300f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:50.127539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:46:50.127539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:46:50.127539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:46:50.127539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:46:50.127539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:46:50.142546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:50.142546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:50.142546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:50.148524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:50.148524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:50.148524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:50.184465 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Getting quotas for project 05a8a1a0e0334559ab3fc9a63685fa69. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:46:50.190018 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Getting quotas for user 5f10bf98bc784be7bf2f8fde1ddbef44 and project 05a8a1a0e0334559ab3fc9a63685fa69. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:46:50.270240 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:46:50.272568 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='904d0419-2a80-4ad2-acb7-4d42ab4211cf',volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:46:50.308926 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8fc537e7-0a18-40d4-9120-344a53ac300f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:50.320472 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8fc537e7-0a18-40d4-9120-344a53ac300f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.215734 Aug 24 16:46:50.321116 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 159/330] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:50 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:50.330787 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e40c5fb7-6baf-4a18-8ece-8e53c4420c2d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:50.331284 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e40c5fb7-6baf-4a18-8ece-8e53c4420c2d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:50.338703 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40c5fb7-6baf-4a18-8ece-8e53c4420c2d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:50.339042 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40c5fb7-6baf-4a18-8ece-8e53c4420c2d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:50.339652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40c5fb7-6baf-4a18-8ece-8e53c4420c2d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:50.340278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40c5fb7-6baf-4a18-8ece-8e53c4420c2d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:50.340892 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40c5fb7-6baf-4a18-8ece-8e53c4420c2d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:50.341318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40c5fb7-6baf-4a18-8ece-8e53c4420c2d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:50.440806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e40c5fb7-6baf-4a18-8ece-8e53c4420c2d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117417 Aug 24 16:46:50.443441 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 160/331] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 16:46:50 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:50.762408 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e0f92ec4-c54f-4c51-a08a-13b0984dd2ee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.296916 Aug 24 16:46:50.772392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 172/332] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:46:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 16:46:50.785184 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f80d9fb6-6cc9-4456-9cb6-88045363a52b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:50.786238 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f80d9fb6-6cc9-4456-9cb6-88045363a52b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:50.932397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f80d9fb6-6cc9-4456-9cb6-88045363a52b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:50.951614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f80d9fb6-6cc9-4456-9cb6-88045363a52b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1089 microversion: 2.1 time: 0.172441 Aug 24 16:46:50.953765 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 161/333] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:50 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1089 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:51.344196 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-855b6bd1-8d35-4f06-b615-cd8cf37e422f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:51.344882 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-855b6bd1-8d35-4f06-b615-cd8cf37e422f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:51.351931 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-855b6bd1-8d35-4f06-b615-cd8cf37e422f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:51.352459 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-855b6bd1-8d35-4f06-b615-cd8cf37e422f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:51.352890 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-855b6bd1-8d35-4f06-b615-cd8cf37e422f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:51.354157 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-855b6bd1-8d35-4f06-b615-cd8cf37e422f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:51.354613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-855b6bd1-8d35-4f06-b615-cd8cf37e422f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:51.355034 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-855b6bd1-8d35-4f06-b615-cd8cf37e422f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:51.579660 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-855b6bd1-8d35-4f06-b615-cd8cf37e422f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:51.588286 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-855b6bd1-8d35-4f06-b615-cd8cf37e422f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.248991 Aug 24 16:46:51.589334 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 173/334] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:51 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:51.742265 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-b3e522bd-e338-49ba-ae5d-bac92108f53b req-b347289c-7860-43e4-a0fc-f9a221ad73f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4", "tag": "8f12eb4e-a077-4950-8f49-746c7b5d2410"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:51.753577 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b3e522bd-e338-49ba-ae5d-bac92108f53b req-b347289c-7860-43e4-a0fc-f9a221ad73f4 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:51.754324 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b3e522bd-e338-49ba-ae5d-bac92108f53b req-b347289c-7860-43e4-a0fc-f9a221ad73f4 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:51.754763 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b3e522bd-e338-49ba-ae5d-bac92108f53b req-b347289c-7860-43e4-a0fc-f9a221ad73f4 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:51.767009 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-b3e522bd-e338-49ba-ae5d-bac92108f53b req-b347289c-7860-43e4-a0fc-f9a221ad73f4 service nova] Creating event network-changed:8f12eb4e-a077-4950-8f49-746c7b5d2410 for instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 on hv-cinder-73116 Aug 24 16:46:51.772627 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-b3e522bd-e338-49ba-ae5d-bac92108f53b req-b347289c-7860-43e4-a0fc-f9a221ad73f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033941 Aug 24 16:46:51.773244 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 162/335] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:51.974996 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-defd3f47-5ece-427d-b9c0-24ef74ecc045 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:51.975840 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-defd3f47-5ece-427d-b9c0-24ef74ecc045 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:52.080003 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-defd3f47-5ece-427d-b9c0-24ef74ecc045 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:52.090209 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-defd3f47-5ece-427d-b9c0-24ef74ecc045 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1089 microversion: 2.1 time: 0.117048 Aug 24 16:46:52.090209 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 174/336] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:51 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1089 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:52.613271 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-71ab3e7c-bbe4-435b-b926-1f4ae7f7a876 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:52.613980 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-71ab3e7c-bbe4-435b-b926-1f4ae7f7a876 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:52.623381 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71ab3e7c-bbe4-435b-b926-1f4ae7f7a876 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:52.624136 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71ab3e7c-bbe4-435b-b926-1f4ae7f7a876 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:52.626136 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71ab3e7c-bbe4-435b-b926-1f4ae7f7a876 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:52.626875 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71ab3e7c-bbe4-435b-b926-1f4ae7f7a876 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:52.627543 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71ab3e7c-bbe4-435b-b926-1f4ae7f7a876 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:52.628265 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-71ab3e7c-bbe4-435b-b926-1f4ae7f7a876 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:52.940555 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-71ab3e7c-bbe4-435b-b926-1f4ae7f7a876 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:52.949344 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-71ab3e7c-bbe4-435b-b926-1f4ae7f7a876 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.341833 Aug 24 16:46:52.949932 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 163/337] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:52 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:53.113201 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-613096c5-5bd8-4e76-8fcf-c2dea245b6c2 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:53.114345 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-613096c5-5bd8-4e76-8fcf-c2dea245b6c2 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:53.122196 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-613096c5-5bd8-4e76-8fcf-c2dea245b6c2 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:53.122773 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-613096c5-5bd8-4e76-8fcf-c2dea245b6c2 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:53.123392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-613096c5-5bd8-4e76-8fcf-c2dea245b6c2 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:53.126134 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-613096c5-5bd8-4e76-8fcf-c2dea245b6c2 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:53.126379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-613096c5-5bd8-4e76-8fcf-c2dea245b6c2 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:53.127030 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-613096c5-5bd8-4e76-8fcf-c2dea245b6c2 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:53.215363 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-613096c5-5bd8-4e76-8fcf-c2dea245b6c2 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:53.226406 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-613096c5-5bd8-4e76-8fcf-c2dea245b6c2 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1187 microversion: 2.1 time: 0.119377 Aug 24 16:46:53.227686 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 175/338] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:53 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1187 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:53.971322 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-fc4a6d8a-b924-4e95-8f39-ab150a09f1ae tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:53.971939 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-fc4a6d8a-b924-4e95-8f39-ab150a09f1ae tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:53.985900 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc4a6d8a-b924-4e95-8f39-ab150a09f1ae tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:53.986655 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc4a6d8a-b924-4e95-8f39-ab150a09f1ae tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:53.987305 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc4a6d8a-b924-4e95-8f39-ab150a09f1ae tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:53.988225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc4a6d8a-b924-4e95-8f39-ab150a09f1ae tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:53.988892 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc4a6d8a-b924-4e95-8f39-ab150a09f1ae tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:53.994159 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc4a6d8a-b924-4e95-8f39-ab150a09f1ae tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:54.242401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fc4a6d8a-b924-4e95-8f39-ab150a09f1ae tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:54.247580 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9c2288a2-bab6-40d5-b59f-d7bd3cb9780e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:54.249011 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9c2288a2-bab6-40d5-b59f-d7bd3cb9780e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:54.251638 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-fc4a6d8a-b924-4e95-8f39-ab150a09f1ae tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.283959 Aug 24 16:46:54.252234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 164/339] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:53 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:54.258764 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2288a2-bab6-40d5-b59f-d7bd3cb9780e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:54.259253 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2288a2-bab6-40d5-b59f-d7bd3cb9780e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:54.259688 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2288a2-bab6-40d5-b59f-d7bd3cb9780e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:54.260669 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2288a2-bab6-40d5-b59f-d7bd3cb9780e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:54.260936 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2288a2-bab6-40d5-b59f-d7bd3cb9780e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:54.261358 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2288a2-bab6-40d5-b59f-d7bd3cb9780e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:54.366135 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9c2288a2-bab6-40d5-b59f-d7bd3cb9780e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:54.392440 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9c2288a2-bab6-40d5-b59f-d7bd3cb9780e tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1205 microversion: 2.1 time: 0.142313 Aug 24 16:46:54.395155 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 176/340] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:54 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1205 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:55.279502 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-193e6ba0-ffda-4687-933f-b734569fee6e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:55.280825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-193e6ba0-ffda-4687-933f-b734569fee6e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:55.294670 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-193e6ba0-ffda-4687-933f-b734569fee6e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:55.296008 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-193e6ba0-ffda-4687-933f-b734569fee6e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:55.297122 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-193e6ba0-ffda-4687-933f-b734569fee6e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:55.299616 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-193e6ba0-ffda-4687-933f-b734569fee6e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:55.300882 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-193e6ba0-ffda-4687-933f-b734569fee6e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:55.301621 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-193e6ba0-ffda-4687-933f-b734569fee6e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:55.416325 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-631763d6-8e01-4d59-ac4e-c4e07a60ac0c tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:55.416935 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-631763d6-8e01-4d59-ac4e-c4e07a60ac0c tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:55.424158 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-631763d6-8e01-4d59-ac4e-c4e07a60ac0c tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:55.424673 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-631763d6-8e01-4d59-ac4e-c4e07a60ac0c tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:55.425100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-631763d6-8e01-4d59-ac4e-c4e07a60ac0c tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:55.425789 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-631763d6-8e01-4d59-ac4e-c4e07a60ac0c tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:55.426326 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-631763d6-8e01-4d59-ac4e-c4e07a60ac0c tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:55.426692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-631763d6-8e01-4d59-ac4e-c4e07a60ac0c tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:56.029549 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-193e6ba0-ffda-4687-933f-b734569fee6e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:56.036538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-193e6ba0-ffda-4687-933f-b734569fee6e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.766362 Aug 24 16:46:56.037488 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 165/341] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:55 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:56.042583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-631763d6-8e01-4d59-ac4e-c4e07a60ac0c tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:56.057969 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-631763d6-8e01-4d59-ac4e-c4e07a60ac0c tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1272 microversion: 2.1 time: 0.645478 Aug 24 16:46:56.060406 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 177/342] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:55 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1272 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:56.621895 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-d38d6729-0f10-4cd8-a4a4-527e4196a6e8 req-a74a4de1-3810-4bbd-b8b9-e907c37f0e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b4ea3cd-ed8d-4169-8be6-716b693de76d", "tag": "a3e2b5de-778c-4f0f-bb74-761971b6f904"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:56.634390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d38d6729-0f10-4cd8-a4a4-527e4196a6e8 req-a74a4de1-3810-4bbd-b8b9-e907c37f0e48 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:56.635225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d38d6729-0f10-4cd8-a4a4-527e4196a6e8 req-a74a4de1-3810-4bbd-b8b9-e907c37f0e48 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:56.635883 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d38d6729-0f10-4cd8-a4a4-527e4196a6e8 req-a74a4de1-3810-4bbd-b8b9-e907c37f0e48 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:56.640586 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=100 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:56.648856 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-d38d6729-0f10-4cd8-a4a4-527e4196a6e8 req-a74a4de1-3810-4bbd-b8b9-e907c37f0e48 service nova] Creating event network-changed:a3e2b5de-778c-4f0f-bb74-761971b6f904 for instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d on hv-cinder-73116 Aug 24 16:46:56.655583 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-d38d6729-0f10-4cd8-a4a4-527e4196a6e8 req-a74a4de1-3810-4bbd-b8b9-e907c37f0e48 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036855 Aug 24 16:46:56.656982 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 166/343] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:57.059775 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-11f98fcb-a3d2-4a84-8712-914749ed1b4a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:57.061096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-11f98fcb-a3d2-4a84-8712-914749ed1b4a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:57.072018 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11f98fcb-a3d2-4a84-8712-914749ed1b4a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:57.073058 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11f98fcb-a3d2-4a84-8712-914749ed1b4a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:57.073483 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11f98fcb-a3d2-4a84-8712-914749ed1b4a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:57.075071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11f98fcb-a3d2-4a84-8712-914749ed1b4a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:57.075713 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11f98fcb-a3d2-4a84-8712-914749ed1b4a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:57.076650 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11f98fcb-a3d2-4a84-8712-914749ed1b4a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:57.083944 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9bd008b1-d45d-4c6b-b60a-ce020469a144 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:57.084889 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9bd008b1-d45d-4c6b-b60a-ce020469a144 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:57.097257 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9bd008b1-d45d-4c6b-b60a-ce020469a144 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:57.098004 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9bd008b1-d45d-4c6b-b60a-ce020469a144 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:57.098628 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9bd008b1-d45d-4c6b-b60a-ce020469a144 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:57.099692 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9bd008b1-d45d-4c6b-b60a-ce020469a144 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:57.100473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9bd008b1-d45d-4c6b-b60a-ce020469a144 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:57.102352 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9bd008b1-d45d-4c6b-b60a-ce020469a144 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:57.390699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-11f98fcb-a3d2-4a84-8712-914749ed1b4a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:57.403640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-11f98fcb-a3d2-4a84-8712-914749ed1b4a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.347221 Aug 24 16:46:57.404013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 178/344] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:57 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:57.439442 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9bd008b1-d45d-4c6b-b60a-ce020469a144 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:57.471286 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9bd008b1-d45d-4c6b-b60a-ce020469a144 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1260 microversion: 2.1 time: 0.390459 Aug 24 16:46:57.472769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 167/345] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:57 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1260 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:58.425767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f8a6dde6-c6dc-472d-b074-fb00b175d54c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:58.426371 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f8a6dde6-c6dc-472d-b074-fb00b175d54c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:58.433305 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8a6dde6-c6dc-472d-b074-fb00b175d54c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:58.433798 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8a6dde6-c6dc-472d-b074-fb00b175d54c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:58.434289 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8a6dde6-c6dc-472d-b074-fb00b175d54c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:58.435236 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8a6dde6-c6dc-472d-b074-fb00b175d54c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:58.435676 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8a6dde6-c6dc-472d-b074-fb00b175d54c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:58.436091 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8a6dde6-c6dc-472d-b074-fb00b175d54c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:58.494050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-57a8e415-ed26-487f-a41a-cee41bc77203 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:58.494691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-57a8e415-ed26-487f-a41a-cee41bc77203 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:58.502918 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-57a8e415-ed26-487f-a41a-cee41bc77203 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:58.503418 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-57a8e415-ed26-487f-a41a-cee41bc77203 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:58.503850 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-57a8e415-ed26-487f-a41a-cee41bc77203 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:58.504797 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-57a8e415-ed26-487f-a41a-cee41bc77203 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:58.505674 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-57a8e415-ed26-487f-a41a-cee41bc77203 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:58.506325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-57a8e415-ed26-487f-a41a-cee41bc77203 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:58.659169 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f8a6dde6-c6dc-472d-b074-fb00b175d54c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:58.670584 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f8a6dde6-c6dc-472d-b074-fb00b175d54c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.249078 Aug 24 16:46:58.675587 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 179/346] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:58 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:58.712163 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-57a8e415-ed26-487f-a41a-cee41bc77203 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:58.722961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-57a8e415-ed26-487f-a41a-cee41bc77203 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1260 microversion: 2.1 time: 0.232935 Aug 24 16:46:58.723590 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 168/347] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:58 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:59.695002 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dae0dbe2-f577-4cd2-a23e-59df9534f8bd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:59.695753 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-dae0dbe2-f577-4cd2-a23e-59df9534f8bd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:59.702752 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae0dbe2-f577-4cd2-a23e-59df9534f8bd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:59.703249 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae0dbe2-f577-4cd2-a23e-59df9534f8bd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:59.704312 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae0dbe2-f577-4cd2-a23e-59df9534f8bd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:59.705254 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae0dbe2-f577-4cd2-a23e-59df9534f8bd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:59.705720 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae0dbe2-f577-4cd2-a23e-59df9534f8bd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:59.706147 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae0dbe2-f577-4cd2-a23e-59df9534f8bd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:59.745478 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-59c0fe27-842b-487b-b308-2bdc9c440e5a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:59.750582 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-59c0fe27-842b-487b-b308-2bdc9c440e5a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:59.762023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59c0fe27-842b-487b-b308-2bdc9c440e5a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:59.762888 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59c0fe27-842b-487b-b308-2bdc9c440e5a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:59.763477 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59c0fe27-842b-487b-b308-2bdc9c440e5a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:59.764461 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59c0fe27-842b-487b-b308-2bdc9c440e5a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:59.792136 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59c0fe27-842b-487b-b308-2bdc9c440e5a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:59.792136 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59c0fe27-842b-487b-b308-2bdc9c440e5a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:59.946413 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-dae0dbe2-f577-4cd2-a23e-59df9534f8bd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:59.953954 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-dae0dbe2-f577-4cd2-a23e-59df9534f8bd tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.262738 Aug 24 16:46:59.954619 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 180/348] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:59 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:00.024068 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-59c0fe27-842b-487b-b308-2bdc9c440e5a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:00.037544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-59c0fe27-842b-487b-b308-2bdc9c440e5a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1260 microversion: 2.1 time: 0.296082 Aug 24 16:47:00.037544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 169/349] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:59 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:00.991325 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bc4275c2-b4cd-4c3e-a732-ba8c850afcea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:00.992199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bc4275c2-b4cd-4c3e-a732-ba8c850afcea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:00.994303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:01.001953 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4275c2-b4cd-4c3e-a732-ba8c850afcea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:01.005623 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4275c2-b4cd-4c3e-a732-ba8c850afcea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:01.005623 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4275c2-b4cd-4c3e-a732-ba8c850afcea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:01.005623 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4275c2-b4cd-4c3e-a732-ba8c850afcea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:01.005623 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4275c2-b4cd-4c3e-a732-ba8c850afcea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:01.006288 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc4275c2-b4cd-4c3e-a732-ba8c850afcea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:01.065319 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-18b5acb3-cc2f-4487-a9a5-01c8611e7e7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:01.067730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-18b5acb3-cc2f-4487-a9a5-01c8611e7e7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:01.072581 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:01.082694 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-18b5acb3-cc2f-4487-a9a5-01c8611e7e7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:01.083596 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-18b5acb3-cc2f-4487-a9a5-01c8611e7e7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:01.085137 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-18b5acb3-cc2f-4487-a9a5-01c8611e7e7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:01.086444 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-18b5acb3-cc2f-4487-a9a5-01c8611e7e7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:01.087374 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-18b5acb3-cc2f-4487-a9a5-01c8611e7e7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:01.088574 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-18b5acb3-cc2f-4487-a9a5-01c8611e7e7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:01.265214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bc4275c2-b4cd-4c3e-a732-ba8c850afcea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:01.275042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bc4275c2-b4cd-4c3e-a732-ba8c850afcea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.287517 Aug 24 16:47:01.288853 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 181/350] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:00 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:01.321814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-18b5acb3-cc2f-4487-a9a5-01c8611e7e7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:01.339235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-18b5acb3-cc2f-4487-a9a5-01c8611e7e7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1260 microversion: 2.1 time: 0.284089 Aug 24 16:47:01.340113 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 170/351] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:01 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1260 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:02.302550 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6d138fc2-6f19-414a-b2da-c10c472fc4c7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:02.303218 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6d138fc2-6f19-414a-b2da-c10c472fc4c7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:02.305853 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=8 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:02.312265 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d138fc2-6f19-414a-b2da-c10c472fc4c7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:02.313427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d138fc2-6f19-414a-b2da-c10c472fc4c7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:02.314268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d138fc2-6f19-414a-b2da-c10c472fc4c7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:02.316753 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d138fc2-6f19-414a-b2da-c10c472fc4c7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:02.319493 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d138fc2-6f19-414a-b2da-c10c472fc4c7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:02.319885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d138fc2-6f19-414a-b2da-c10c472fc4c7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:02.365945 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-218d823c-7be8-4dfe-ac49-801cf012c250 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:02.366603 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-218d823c-7be8-4dfe-ac49-801cf012c250 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:02.373921 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-218d823c-7be8-4dfe-ac49-801cf012c250 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:02.374735 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-218d823c-7be8-4dfe-ac49-801cf012c250 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:02.375351 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-218d823c-7be8-4dfe-ac49-801cf012c250 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:02.376368 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-218d823c-7be8-4dfe-ac49-801cf012c250 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:02.377326 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-218d823c-7be8-4dfe-ac49-801cf012c250 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:02.377845 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-218d823c-7be8-4dfe-ac49-801cf012c250 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:02.648801 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6d138fc2-6f19-414a-b2da-c10c472fc4c7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:02.694123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6d138fc2-6f19-414a-b2da-c10c472fc4c7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.399622 Aug 24 16:47:02.694703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 182/352] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:02 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:02.698966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-218d823c-7be8-4dfe-ac49-801cf012c250 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:02.711068 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-218d823c-7be8-4dfe-ac49-801cf012c250 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1260 microversion: 2.1 time: 0.353455 Aug 24 16:47:02.712683 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 171/353] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:02 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1260 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:03.718506 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1c83e267-33f8-45d0-9d95-4139fd44cbf3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:03.719040 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1c83e267-33f8-45d0-9d95-4139fd44cbf3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:03.727497 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c83e267-33f8-45d0-9d95-4139fd44cbf3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:03.729783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c83e267-33f8-45d0-9d95-4139fd44cbf3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:03.729783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c83e267-33f8-45d0-9d95-4139fd44cbf3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:03.730398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c83e267-33f8-45d0-9d95-4139fd44cbf3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:03.731084 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c83e267-33f8-45d0-9d95-4139fd44cbf3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:03.731726 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c83e267-33f8-45d0-9d95-4139fd44cbf3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:03.735155 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-277f5ee0-208d-4cb7-a614-d6c0b2d3c34f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:03.736875 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-277f5ee0-208d-4cb7-a614-d6c0b2d3c34f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:03.737426 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:03.746637 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-277f5ee0-208d-4cb7-a614-d6c0b2d3c34f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:03.747204 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-277f5ee0-208d-4cb7-a614-d6c0b2d3c34f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:03.747837 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-277f5ee0-208d-4cb7-a614-d6c0b2d3c34f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:03.748741 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-277f5ee0-208d-4cb7-a614-d6c0b2d3c34f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:03.749483 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-277f5ee0-208d-4cb7-a614-d6c0b2d3c34f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:03.749921 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-277f5ee0-208d-4cb7-a614-d6c0b2d3c34f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:04.055470 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1c83e267-33f8-45d0-9d95-4139fd44cbf3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:04.072364 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-277f5ee0-208d-4cb7-a614-d6c0b2d3c34f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:04.074915 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1c83e267-33f8-45d0-9d95-4139fd44cbf3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.361164 Aug 24 16:47:04.081599 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-277f5ee0-208d-4cb7-a614-d6c0b2d3c34f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1260 microversion: 2.1 time: 0.350263 Aug 24 16:47:04.086029 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 172/354] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:03 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1260 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:04.090586 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 183/355] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:03 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:05.103279 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-4523e92f-fb1e-45dd-998f-6cc459382672 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:05.106501 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-4523e92f-fb1e-45dd-998f-6cc459382672 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:05.114776 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-43a20b44-a262-4e1f-97e6-60a827096283 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:05.123257 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-43a20b44-a262-4e1f-97e6-60a827096283 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:05.124187 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4523e92f-fb1e-45dd-998f-6cc459382672 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:05.124187 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4523e92f-fb1e-45dd-998f-6cc459382672 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:05.124187 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4523e92f-fb1e-45dd-998f-6cc459382672 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:05.124773 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4523e92f-fb1e-45dd-998f-6cc459382672 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:05.125478 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4523e92f-fb1e-45dd-998f-6cc459382672 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:05.126292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4523e92f-fb1e-45dd-998f-6cc459382672 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:05.135869 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43a20b44-a262-4e1f-97e6-60a827096283 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:05.136822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43a20b44-a262-4e1f-97e6-60a827096283 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:05.138446 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43a20b44-a262-4e1f-97e6-60a827096283 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:05.140547 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43a20b44-a262-4e1f-97e6-60a827096283 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:05.141434 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43a20b44-a262-4e1f-97e6-60a827096283 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:05.142368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43a20b44-a262-4e1f-97e6-60a827096283 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:05.394039 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4523e92f-fb1e-45dd-998f-6cc459382672 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:05.402003 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-43a20b44-a262-4e1f-97e6-60a827096283 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:05.407363 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-4523e92f-fb1e-45dd-998f-6cc459382672 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.312475 Aug 24 16:47:05.410626 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 173/356] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:05 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:05.415880 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-43a20b44-a262-4e1f-97e6-60a827096283 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1260 microversion: 2.1 time: 0.311480 Aug 24 16:47:05.416942 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 184/357] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:05 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1260 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:06.431321 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9f65c496-a93a-4b0d-b244-42d65ce1975d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:06.432630 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9f65c496-a93a-4b0d-b244-42d65ce1975d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:06.439505 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9f65c496-a93a-4b0d-b244-42d65ce1975d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:06.440450 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9f65c496-a93a-4b0d-b244-42d65ce1975d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:06.442198 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e344abd9-8c66-48c0-a43c-eb09c4f105ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:06.442872 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e344abd9-8c66-48c0-a43c-eb09c4f105ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:06.443002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9f65c496-a93a-4b0d-b244-42d65ce1975d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:06.443809 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9f65c496-a93a-4b0d-b244-42d65ce1975d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:06.445207 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9f65c496-a93a-4b0d-b244-42d65ce1975d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:06.445871 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9f65c496-a93a-4b0d-b244-42d65ce1975d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:06.453875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e344abd9-8c66-48c0-a43c-eb09c4f105ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:06.455168 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e344abd9-8c66-48c0-a43c-eb09c4f105ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:06.455608 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e344abd9-8c66-48c0-a43c-eb09c4f105ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:06.458548 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e344abd9-8c66-48c0-a43c-eb09c4f105ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:06.461476 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e344abd9-8c66-48c0-a43c-eb09c4f105ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:06.464428 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e344abd9-8c66-48c0-a43c-eb09c4f105ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:06.680986 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9f65c496-a93a-4b0d-b244-42d65ce1975d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:06.700939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e344abd9-8c66-48c0-a43c-eb09c4f105ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:06.715652 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e344abd9-8c66-48c0-a43c-eb09c4f105ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1260 microversion: 2.1 time: 0.271007 Aug 24 16:47:06.715652 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 185/358] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:06 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:06.715887 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9f65c496-a93a-4b0d-b244-42d65ce1975d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.284615 Aug 24 16:47:06.715887 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 174/359] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:06 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:07.766922 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-53efa8b8-151c-465a-93ad-c97084cf90fe tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:07.773955 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-41a67ee5-cf2b-4a1f-ad8c-d9f14be20871 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:07.776119 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-53efa8b8-151c-465a-93ad-c97084cf90fe tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:07.778793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-41a67ee5-cf2b-4a1f-ad8c-d9f14be20871 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:07.802938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53efa8b8-151c-465a-93ad-c97084cf90fe tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:07.803759 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53efa8b8-151c-465a-93ad-c97084cf90fe tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:07.804696 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41a67ee5-cf2b-4a1f-ad8c-d9f14be20871 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:07.805021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53efa8b8-151c-465a-93ad-c97084cf90fe tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:07.806586 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53efa8b8-151c-465a-93ad-c97084cf90fe tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:07.807342 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41a67ee5-cf2b-4a1f-ad8c-d9f14be20871 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:07.808449 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41a67ee5-cf2b-4a1f-ad8c-d9f14be20871 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:07.809534 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41a67ee5-cf2b-4a1f-ad8c-d9f14be20871 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:07.810208 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41a67ee5-cf2b-4a1f-ad8c-d9f14be20871 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:07.810733 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41a67ee5-cf2b-4a1f-ad8c-d9f14be20871 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:07.811801 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53efa8b8-151c-465a-93ad-c97084cf90fe tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:07.812315 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53efa8b8-151c-465a-93ad-c97084cf90fe tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:08.141102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-41a67ee5-cf2b-4a1f-ad8c-d9f14be20871 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:08.146323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-53efa8b8-151c-465a-93ad-c97084cf90fe tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:08.154054 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-41a67ee5-cf2b-4a1f-ad8c-d9f14be20871 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1724 microversion: 2.1 time: 0.421725 Aug 24 16:47:08.156411 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-53efa8b8-151c-465a-93ad-c97084cf90fe tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1260 microversion: 2.1 time: 0.426871 Aug 24 16:47:08.158145 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 175/360] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:07 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1724 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:08.163615 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 186/361] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:07 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1260 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:08.255475 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f86f0697-3b32-4752-883d-2f48f256b4dd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:08.256275 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f86f0697-3b32-4752-883d-2f48f256b4dd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:08.267763 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f86f0697-3b32-4752-883d-2f48f256b4dd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:08.274394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f86f0697-3b32-4752-883d-2f48f256b4dd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:08.274394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f86f0697-3b32-4752-883d-2f48f256b4dd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:08.274394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f86f0697-3b32-4752-883d-2f48f256b4dd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:08.274394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f86f0697-3b32-4752-883d-2f48f256b4dd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:08.274764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f86f0697-3b32-4752-883d-2f48f256b4dd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:08.327290 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f86f0697-3b32-4752-883d-2f48f256b4dd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/ips" status: 200 len: 152 microversion: 2.20 time: 0.076380 Aug 24 16:47:08.331974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 176/362] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Aug 24 16:47:08 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/ips => generated 152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:47:08.467541 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-20a40835-054f-4534-8e8d-4e3f99872700 req-eac019b6-d4e0-4f46-9c6f-039b70897bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4ea3cd-ed8d-4169-8be6-716b693de76d", "name": "network-vif-plugged", "status": "completed", "tag": "a3e2b5de-778c-4f0f-bb74-761971b6f904"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:08.491083 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-20a40835-054f-4534-8e8d-4e3f99872700 req-eac019b6-d4e0-4f46-9c6f-039b70897bd8 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:08.492016 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-20a40835-054f-4534-8e8d-4e3f99872700 req-eac019b6-d4e0-4f46-9c6f-039b70897bd8 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:08.493036 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-20a40835-054f-4534-8e8d-4e3f99872700 req-eac019b6-d4e0-4f46-9c6f-039b70897bd8 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:08.523002 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-20a40835-054f-4534-8e8d-4e3f99872700 req-eac019b6-d4e0-4f46-9c6f-039b70897bd8 service nova] Creating event network-vif-plugged:a3e2b5de-778c-4f0f-bb74-761971b6f904 for instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d on hv-cinder-73116 Aug 24 16:47:08.544590 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-20a40835-054f-4534-8e8d-4e3f99872700 req-eac019b6-d4e0-4f46-9c6f-039b70897bd8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080086 Aug 24 16:47:08.545642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 187/363] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:09.189128 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-61a1cb60-1d1b-4af8-a891-b0ba83c87c04 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:09.190505 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a081e85b-09d3-4102-bf50-78f4e88c5751 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:09.193574 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a081e85b-09d3-4102-bf50-78f4e88c5751 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:09.193943 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-61a1cb60-1d1b-4af8-a891-b0ba83c87c04 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:09.213615 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61a1cb60-1d1b-4af8-a891-b0ba83c87c04 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:09.215378 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:09.216439 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61a1cb60-1d1b-4af8-a891-b0ba83c87c04 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:09.218539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a081e85b-09d3-4102-bf50-78f4e88c5751 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:09.219332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61a1cb60-1d1b-4af8-a891-b0ba83c87c04 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:09.220494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61a1cb60-1d1b-4af8-a891-b0ba83c87c04 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:09.224561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a081e85b-09d3-4102-bf50-78f4e88c5751 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:09.225029 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61a1cb60-1d1b-4af8-a891-b0ba83c87c04 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:09.225632 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a081e85b-09d3-4102-bf50-78f4e88c5751 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:09.226402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61a1cb60-1d1b-4af8-a891-b0ba83c87c04 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:09.231596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a081e85b-09d3-4102-bf50-78f4e88c5751 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:09.232458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a081e85b-09d3-4102-bf50-78f4e88c5751 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:09.236910 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a081e85b-09d3-4102-bf50-78f4e88c5751 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:09.604724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-61a1cb60-1d1b-4af8-a891-b0ba83c87c04 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:09.616359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a081e85b-09d3-4102-bf50-78f4e88c5751 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:09.624317 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a081e85b-09d3-4102-bf50-78f4e88c5751 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1701 microversion: 2.1 time: 0.441005 Aug 24 16:47:09.628060 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-61a1cb60-1d1b-4af8-a891-b0ba83c87c04 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1260 microversion: 2.1 time: 0.449280 Aug 24 16:47:09.630443 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 177/364] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:09 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1260 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:09.645435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 188/365] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:09 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1701 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:09.651953 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e3b9537d-bf68-498b-9e4c-cb38eea9da8b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:09.662964 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3b9537d-bf68-498b-9e4c-cb38eea9da8b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:09.663708 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3b9537d-bf68-498b-9e4c-cb38eea9da8b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:09.664311 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3b9537d-bf68-498b-9e4c-cb38eea9da8b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:09.687753 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e3b9537d-bf68-498b-9e4c-cb38eea9da8b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Going to try to start instance {{(pid=127627) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 16:47:09.891260 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e3b9537d-bf68-498b-9e4c-cb38eea9da8b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "POST /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/action" status: 202 len: 0 microversion: 2.1 time: 0.242907 Aug 24 16:47:09.892031 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 189/366] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:47:09 2022] POST /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:47:09.901802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-401b8489-bc38-480c-b1cf-c96014e5acbf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:09.902313 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-401b8489-bc38-480c-b1cf-c96014e5acbf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:09.918984 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-401b8489-bc38-480c-b1cf-c96014e5acbf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:09.921895 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-401b8489-bc38-480c-b1cf-c96014e5acbf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:09.922550 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-401b8489-bc38-480c-b1cf-c96014e5acbf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:09.927906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-401b8489-bc38-480c-b1cf-c96014e5acbf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:09.928773 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-401b8489-bc38-480c-b1cf-c96014e5acbf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:09.929370 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-401b8489-bc38-480c-b1cf-c96014e5acbf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:10.257947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-401b8489-bc38-480c-b1cf-c96014e5acbf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:10.301291 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-401b8489-bc38-480c-b1cf-c96014e5acbf tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1710 microversion: 2.1 time: 0.404377 Aug 24 16:47:10.302214 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 178/367] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:09 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1710 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:10.654966 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-69c72063-6d42-4ce7-b299-52ebff6e13d9 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:10.655658 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-69c72063-6d42-4ce7-b299-52ebff6e13d9 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:10.672981 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69c72063-6d42-4ce7-b299-52ebff6e13d9 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:10.673766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69c72063-6d42-4ce7-b299-52ebff6e13d9 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:10.674914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69c72063-6d42-4ce7-b299-52ebff6e13d9 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:10.677177 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69c72063-6d42-4ce7-b299-52ebff6e13d9 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:10.680260 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69c72063-6d42-4ce7-b299-52ebff6e13d9 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:10.680900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69c72063-6d42-4ce7-b299-52ebff6e13d9 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:10.853307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-69c72063-6d42-4ce7-b299-52ebff6e13d9 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:10.872729 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-69c72063-6d42-4ce7-b299-52ebff6e13d9 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1260 microversion: 2.1 time: 0.222630 Aug 24 16:47:10.873458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 190/368] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:10 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:10.987259 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-68620a35-3541-4784-8539-adb8c27d8ade tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:10.988191 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-68620a35-3541-4784-8539-adb8c27d8ade tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:10.995632 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68620a35-3541-4784-8539-adb8c27d8ade tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:10.996447 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68620a35-3541-4784-8539-adb8c27d8ade tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:10.997061 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68620a35-3541-4784-8539-adb8c27d8ade tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:10.997956 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68620a35-3541-4784-8539-adb8c27d8ade tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:10.998587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68620a35-3541-4784-8539-adb8c27d8ade tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:10.999161 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68620a35-3541-4784-8539-adb8c27d8ade tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:11.026721 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-68620a35-3541-4784-8539-adb8c27d8ade tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lazy-loading 'flavor' on Instance uuid 1eadb4fd-bee8-4fac-b072-550b720e3e95 {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:47:11.322914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-694f3d07-1d36-4b84-9be0-debfb2189b73 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:11.323521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-694f3d07-1d36-4b84-9be0-debfb2189b73 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:11.329479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f3d07-1d36-4b84-9be0-debfb2189b73 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:11.329972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f3d07-1d36-4b84-9be0-debfb2189b73 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:11.331005 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f3d07-1d36-4b84-9be0-debfb2189b73 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:11.331815 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f3d07-1d36-4b84-9be0-debfb2189b73 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:11.332479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f3d07-1d36-4b84-9be0-debfb2189b73 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:11.332902 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-694f3d07-1d36-4b84-9be0-debfb2189b73 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:11.627753 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-694f3d07-1d36-4b84-9be0-debfb2189b73 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:11.647645 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-694f3d07-1d36-4b84-9be0-debfb2189b73 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1710 microversion: 2.1 time: 0.328368 Aug 24 16:47:11.648283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 191/369] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:11 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1710 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:11.897741 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b52fe155-b78e-432a-b840-2f136545f50f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:11.898372 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b52fe155-b78e-432a-b840-2f136545f50f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:11.921013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fe155-b78e-432a-b840-2f136545f50f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:11.921013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fe155-b78e-432a-b840-2f136545f50f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:11.921013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fe155-b78e-432a-b840-2f136545f50f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:11.921013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fe155-b78e-432a-b840-2f136545f50f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:11.921502 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fe155-b78e-432a-b840-2f136545f50f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:11.921502 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fe155-b78e-432a-b840-2f136545f50f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:12.046548 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-68620a35-3541-4784-8539-adb8c27d8ade tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "POST /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/action" status: 202 len: 0 microversion: 2.20 time: 1.063701 Aug 24 16:47:12.048790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 179/370] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 24 16:47:10 2022] POST /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/action => generated 0 bytes in 1067 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:47:12.058916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:12.065368 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:12.082285 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:12.083138 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:12.087739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:12.087739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:12.087739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:12.087739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:12.279058 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b52fe155-b78e-432a-b840-2f136545f50f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:12.293114 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b52fe155-b78e-432a-b840-2f136545f50f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1444 microversion: 2.1 time: 0.401927 Aug 24 16:47:12.295052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 192/371] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:11 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1444 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:12.316672 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f0030d80-3006-421b-9bc2-b73f5109b16b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:12.317584 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f0030d80-3006-421b-9bc2-b73f5109b16b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:12.329655 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0030d80-3006-421b-9bc2-b73f5109b16b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:12.331011 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0030d80-3006-421b-9bc2-b73f5109b16b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:12.331648 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0030d80-3006-421b-9bc2-b73f5109b16b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:12.332604 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0030d80-3006-421b-9bc2-b73f5109b16b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:12.333704 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0030d80-3006-421b-9bc2-b73f5109b16b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:12.334590 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0030d80-3006-421b-9bc2-b73f5109b16b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:12.345756 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:12.355853 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:12.360844 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:12.362687 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b3a90174-0b49-4ed1-80c2-01acab135908 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.308015 Aug 24 16:47:12.373085 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 180/372] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:12 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:12.535628 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f0030d80-3006-421b-9bc2-b73f5109b16b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:12.546073 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f0030d80-3006-421b-9bc2-b73f5109b16b tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1444 microversion: 2.1 time: 0.234323 Aug 24 16:47:12.549091 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 193/373] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:12 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1444 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:12.673915 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a184cee4-54ec-42e7-91b1-a4cb4567a527 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:12.674514 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a184cee4-54ec-42e7-91b1-a4cb4567a527 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:12.687196 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a184cee4-54ec-42e7-91b1-a4cb4567a527 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:12.690944 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a184cee4-54ec-42e7-91b1-a4cb4567a527 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:12.690944 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a184cee4-54ec-42e7-91b1-a4cb4567a527 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:12.690944 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a184cee4-54ec-42e7-91b1-a4cb4567a527 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:12.693434 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a184cee4-54ec-42e7-91b1-a4cb4567a527 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:12.694859 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a184cee4-54ec-42e7-91b1-a4cb4567a527 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:12.993316 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a184cee4-54ec-42e7-91b1-a4cb4567a527 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:13.001333 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:13.005777 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a184cee4-54ec-42e7-91b1-a4cb4567a527 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1710 microversion: 2.1 time: 0.335741 Aug 24 16:47:13.007052 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 181/374] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:12 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1710 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:13.388533 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:13.389268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:13.401256 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:13.401989 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:13.404290 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:13.405410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:13.406490 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:13.408615 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:13.621676 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:13.634965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:13.639882 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:13.644979 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0e14a49b-3044-482c-b628-0bfe00b5dec0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.260604 Aug 24 16:47:13.664031 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 194/375] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:13 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:14.028873 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5125aa80-4f1d-4d88-bcf1-1b67d90eff80 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:14.030394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-5125aa80-4f1d-4d88-bcf1-1b67d90eff80 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:14.038138 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5125aa80-4f1d-4d88-bcf1-1b67d90eff80 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:14.038790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5125aa80-4f1d-4d88-bcf1-1b67d90eff80 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:14.039295 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5125aa80-4f1d-4d88-bcf1-1b67d90eff80 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:14.040147 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5125aa80-4f1d-4d88-bcf1-1b67d90eff80 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:14.040719 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5125aa80-4f1d-4d88-bcf1-1b67d90eff80 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:14.041364 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5125aa80-4f1d-4d88-bcf1-1b67d90eff80 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:14.315034 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5125aa80-4f1d-4d88-bcf1-1b67d90eff80 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:14.327469 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5125aa80-4f1d-4d88-bcf1-1b67d90eff80 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1714 microversion: 2.1 time: 0.303017 Aug 24 16:47:14.328164 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 182/376] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:14 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1714 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:14.679423 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:14.680891 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:14.689531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:14.690664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:14.691863 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:14.692873 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:14.693570 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:14.698918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:14.889508 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:14.902462 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:14.904671 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:14.906128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ad24bc78-b0f2-4818-9151-4bd78f9880d6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.235539 Aug 24 16:47:14.924065 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 195/377] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:14 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:15.860981 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-3c917751-fbfc-4c53-8747-426231e008e2 req-6abee81b-1819-492e-b108-505d554f233f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b4ea3cd-ed8d-4169-8be6-716b693de76d", "tag": "a3e2b5de-778c-4f0f-bb74-761971b6f904"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:15.866779 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=66 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:15.871959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-3c917751-fbfc-4c53-8747-426231e008e2 req-6abee81b-1819-492e-b108-505d554f233f service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:15.872472 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-3c917751-fbfc-4c53-8747-426231e008e2 req-6abee81b-1819-492e-b108-505d554f233f service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:15.872905 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-3c917751-fbfc-4c53-8747-426231e008e2 req-6abee81b-1819-492e-b108-505d554f233f service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:15.898425 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-3c917751-fbfc-4c53-8747-426231e008e2 req-6abee81b-1819-492e-b108-505d554f233f service nova] Creating event network-changed:a3e2b5de-778c-4f0f-bb74-761971b6f904 for instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d on hv-cinder-73116 Aug 24 16:47:15.910585 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-3c917751-fbfc-4c53-8747-426231e008e2 req-6abee81b-1819-492e-b108-505d554f233f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053143 Aug 24 16:47:15.917964 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 183/378] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:15.931004 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:15.931839 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:15.939300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:15.940146 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:15.941358 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:15.942341 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:15.943009 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:15.943642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:16.201743 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:16.218214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:16.228335 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:16.230396 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-12bdee4b-f8f0-4ef8-a744-32c79b80b1a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.303228 Aug 24 16:47:16.232649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 196/379] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:15 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:47:17.260973 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:17.262277 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:17.270185 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:17.270987 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:17.271588 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:17.272544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:17.272996 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:17.273586 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:17.680386 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:17.693038 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:17.694877 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:17.696233 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3db84ebe-938a-4eec-b068-b639ee589b5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.439717 Aug 24 16:47:17.696839 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 184/380] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:17 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:18.721835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:18.722842 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:18.729889 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:18.730465 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:18.730900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:18.731613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:18.732064 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:18.732686 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:18.876083 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:18.886217 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:18.887799 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:18.889036 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-db13cb25-3488-4058-9d96-944285e4d658 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.171281 Aug 24 16:47:18.889612 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 197/381] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:18 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:19.914530 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:19.915148 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:19.922225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:19.922716 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:19.923182 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:19.923950 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:19.924455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:19.925461 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:20.068143 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:20.076232 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:20.080635 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:20.080635 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-35352f80-10a3-4c78-abf8-4b80121e54ea tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.170712 Aug 24 16:47:20.080635 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 185/382] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:19 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:20.361063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-285a80b1-a0d8-41fc-9fbe-25f11c898548 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Action: 'create', calling method: .version_select at 0x7f06a77b2ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-587603887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOS8A96DD1nd7T0jPjABiJQ58aicznYS4e1jDh6g/jbAVbHVltMPovDakwdKVO5cXfF0S3xI6QhJm2LV7iaNC4mzAqad0wgKNVEdB/XPS/NwbGwtjCzICusgDQWeciBfFg=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:20.379315 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-285a80b1-a0d8-41fc-9fbe-25f11c898548 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Getting quotas for project 09e2ab2c313d4448a28a6902b74a0d10. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:47:20.383259 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-285a80b1-a0d8-41fc-9fbe-25f11c898548 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Getting quotas for user 680f726c9e374d97aff5ebe924c84865 and project 09e2ab2c313d4448a28a6902b74a0d10. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:47:20.526172 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-285a80b1-a0d8-41fc-9fbe-25f11c898548 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.168947 Aug 24 16:47:20.526783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 198/383] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 16:47:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:20.634005 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1553714393", "imageRef": "54388921-8a62-4464-a225-e8cbe29c4e91", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-587603887", "networks": [{"uuid": "f599defe-c22e-4f1d-9ae7-6d25663b2f65"}]}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:20.686644 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.network.neutron [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] validate_networks() for [('f599defe-c22e-4f1d-9ae7-6d25663b2f65', None, None, None, None, None)] {{(pid=127626) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:47:21.102485 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:21.103016 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:21.106203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Flavor limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:47:21.106622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Image limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:47:21.107094 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Flavor pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:47:21.107549 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Image pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:47:21.107953 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:47:21.109398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:21.109883 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:21.110310 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:21.111002 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:21.111449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:21.111874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:21.117943 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:21.118431 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:21.118867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:21.119600 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:21.120056 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:21.120513 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:21.138144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Getting quotas for project 09e2ab2c313d4448a28a6902b74a0d10. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:47:21.142203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Getting quotas for user 680f726c9e374d97aff5ebe924c84865 and project 09e2ab2c313d4448a28a6902b74a0d10. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:47:21.154118 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Going to run 1 instances... {{(pid=127626) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:47:21.156378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='54388921-8a62-4464-a225-e8cbe29c4e91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:47:21.249908 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:21.258524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:21.260493 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:21.261649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d90b698d-a3b6-480d-9fcd-b84af34b161b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.164179 Aug 24 16:47:21.262208 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 199/384] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:21 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:21.303647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d4730f08-780e-4556-bb59-46fcdd9f7ac5 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673543 Aug 24 16:47:21.304294 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 186/385] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:47:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:47:21.314905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8e77193f-1572-4008-831d-a0ff1a82e359 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:21.315726 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8e77193f-1572-4008-831d-a0ff1a82e359 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:21.373918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8e77193f-1572-4008-831d-a0ff1a82e359 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:21.380970 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8e77193f-1572-4008-831d-a0ff1a82e359 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1258 microversion: 2.1 time: 0.069839 Aug 24 16:47:21.381542 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 200/386] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:21 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:22.287331 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:22.287912 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:22.294855 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:22.295419 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:22.295982 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:22.296713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:22.297166 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:22.297584 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:22.401083 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6c32db50-7dda-43ba-b302-7dc053e90efe tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:22.401755 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6c32db50-7dda-43ba-b302-7dc053e90efe tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:22.430638 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:22.438987 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:22.440726 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:22.442433 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e2b9b8da-0128-4b95-8886-55f55384dc73 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.160470 Aug 24 16:47:22.442999 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 187/387] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:22 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:22.459827 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6c32db50-7dda-43ba-b302-7dc053e90efe tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:22.466917 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6c32db50-7dda-43ba-b302-7dc053e90efe tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1258 microversion: 2.1 time: 0.069719 Aug 24 16:47:22.467471 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 201/388] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:22 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:23.465407 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:23.465944 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:23.473237 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:23.473720 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:23.474155 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:23.474844 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:23.475296 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:23.475716 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:23.488843 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c222d0c0-7c99-46a2-a0d6-a4a9e6cc0329 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:23.489452 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c222d0c0-7c99-46a2-a0d6-a4a9e6cc0329 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:23.495854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c222d0c0-7c99-46a2-a0d6-a4a9e6cc0329 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:23.496544 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c222d0c0-7c99-46a2-a0d6-a4a9e6cc0329 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:23.496792 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c222d0c0-7c99-46a2-a0d6-a4a9e6cc0329 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:23.497488 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c222d0c0-7c99-46a2-a0d6-a4a9e6cc0329 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:23.497937 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c222d0c0-7c99-46a2-a0d6-a4a9e6cc0329 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:23.498421 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c222d0c0-7c99-46a2-a0d6-a4a9e6cc0329 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:23.517316 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:23.579857 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c222d0c0-7c99-46a2-a0d6-a4a9e6cc0329 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:23.588525 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c222d0c0-7c99-46a2-a0d6-a4a9e6cc0329 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1310 microversion: 2.1 time: 0.104092 Aug 24 16:47:23.589107 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 202/389] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:23 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1310 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:23.672916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:23.682108 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:23.683610 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:23.684808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7f87517d-8819-48a9-8401-030a172a1c3d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.223482 Aug 24 16:47:23.685370 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 188/390] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:23 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:24.611309 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-69cab610-4452-4161-b4b8-596cd6627340 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:24.611912 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-69cab610-4452-4161-b4b8-596cd6627340 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:24.619235 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69cab610-4452-4161-b4b8-596cd6627340 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:24.619718 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69cab610-4452-4161-b4b8-596cd6627340 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:24.622179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69cab610-4452-4161-b4b8-596cd6627340 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:24.622179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69cab610-4452-4161-b4b8-596cd6627340 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:24.622179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69cab610-4452-4161-b4b8-596cd6627340 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:24.622179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69cab610-4452-4161-b4b8-596cd6627340 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:24.697050 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-69cab610-4452-4161-b4b8-596cd6627340 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:24.709220 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-69cab610-4452-4161-b4b8-596cd6627340 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1316 microversion: 2.1 time: 0.102139 Aug 24 16:47:24.712969 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 203/391] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:24 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1316 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:24.713097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:24.713097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:24.720120 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:24.720845 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:24.721559 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:24.722776 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:24.723672 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:24.724220 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:25.035834 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:25.051862 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:25.053980 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:25.055634 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e42f57f0-4308-4407-afdb-fe2ab5765149 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.350332 Aug 24 16:47:25.056710 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 189/392] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:24 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:47:25.730969 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5610bd75-4add-427c-a5ff-b628505de4b1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:25.731820 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5610bd75-4add-427c-a5ff-b628505de4b1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:25.739388 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5610bd75-4add-427c-a5ff-b628505de4b1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:25.740259 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5610bd75-4add-427c-a5ff-b628505de4b1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:25.740931 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5610bd75-4add-427c-a5ff-b628505de4b1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:25.741846 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5610bd75-4add-427c-a5ff-b628505de4b1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:25.742424 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5610bd75-4add-427c-a5ff-b628505de4b1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:25.743078 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5610bd75-4add-427c-a5ff-b628505de4b1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:25.885504 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5610bd75-4add-427c-a5ff-b628505de4b1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:25.894622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5610bd75-4add-427c-a5ff-b628505de4b1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.167490 Aug 24 16:47:25.899561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 204/393] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:25 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:26.079151 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:26.079767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:26.087566 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:26.088141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:26.088969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:26.089811 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:26.090267 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:26.090689 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:26.242849 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:26.251284 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:26.253179 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:26.255849 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-17be5d57-97cb-4818-92a7-b86f124db977 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.179121 Aug 24 16:47:26.256461 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 190/394] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:26 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:26.922224 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-826254da-b31e-427d-a7c7-e14e6e6963fb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:26.922984 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-826254da-b31e-427d-a7c7-e14e6e6963fb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:26.931666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-826254da-b31e-427d-a7c7-e14e6e6963fb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:26.932330 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-826254da-b31e-427d-a7c7-e14e6e6963fb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:26.932970 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-826254da-b31e-427d-a7c7-e14e6e6963fb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:26.934243 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-826254da-b31e-427d-a7c7-e14e6e6963fb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:26.934997 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-826254da-b31e-427d-a7c7-e14e6e6963fb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:26.935656 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-826254da-b31e-427d-a7c7-e14e6e6963fb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:27.085346 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-826254da-b31e-427d-a7c7-e14e6e6963fb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:27.093638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-826254da-b31e-427d-a7c7-e14e6e6963fb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.176174 Aug 24 16:47:27.094433 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 205/395] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:26 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:27.279354 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:27.279954 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:27.287169 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:27.287854 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:27.288294 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:27.293114 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:27.293114 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:27.293114 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:27.433702 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:27.443520 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:27.445080 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:27.446271 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-90c004b3-e1e7-4ac7-ba61-8d1095233c97 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.170865 Aug 24 16:47:27.448933 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 191/396] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:27 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:28.115499 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d450c097-d566-4997-bb79-5ab591fdbd48 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:28.116121 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d450c097-d566-4997-bb79-5ab591fdbd48 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:28.123181 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d450c097-d566-4997-bb79-5ab591fdbd48 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:28.123666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d450c097-d566-4997-bb79-5ab591fdbd48 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:28.124103 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d450c097-d566-4997-bb79-5ab591fdbd48 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:28.124835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d450c097-d566-4997-bb79-5ab591fdbd48 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:28.125317 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d450c097-d566-4997-bb79-5ab591fdbd48 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:28.125742 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d450c097-d566-4997-bb79-5ab591fdbd48 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:28.267905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d450c097-d566-4997-bb79-5ab591fdbd48 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:28.275751 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d450c097-d566-4997-bb79-5ab591fdbd48 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.165141 Aug 24 16:47:28.276300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 206/397] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:28 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:28.469603 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:28.470161 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:28.477438 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:28.477779 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:28.478210 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:28.478892 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:28.479341 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:28.479761 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:28.621937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:28.631684 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:28.633251 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:28.634522 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-4d8941f0-33ee-486c-a783-2c7032483e3c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.168829 Aug 24 16:47:28.635087 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 192/398] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:28 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:29.297480 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-94121aa6-5ba5-4ec2-a4c9-f4ba07dc2ad2 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:29.298243 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-94121aa6-5ba5-4ec2-a4c9-f4ba07dc2ad2 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:29.305741 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94121aa6-5ba5-4ec2-a4c9-f4ba07dc2ad2 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:29.306226 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94121aa6-5ba5-4ec2-a4c9-f4ba07dc2ad2 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:29.306659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94121aa6-5ba5-4ec2-a4c9-f4ba07dc2ad2 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:29.307357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94121aa6-5ba5-4ec2-a4c9-f4ba07dc2ad2 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:29.307808 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94121aa6-5ba5-4ec2-a4c9-f4ba07dc2ad2 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:29.308226 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94121aa6-5ba5-4ec2-a4c9-f4ba07dc2ad2 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:29.445654 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-94121aa6-5ba5-4ec2-a4c9-f4ba07dc2ad2 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:29.453632 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-94121aa6-5ba5-4ec2-a4c9-f4ba07dc2ad2 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.160502 Aug 24 16:47:29.454199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 207/399] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:29 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:29.659162 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:29.659751 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:29.666720 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:29.667206 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:29.667644 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:29.668353 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:29.668818 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:29.669243 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:29.808158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:29.817940 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:29.819598 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:29.820861 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b52d38f4-97a5-4d90-b3eb-151e611364f9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.165972 Aug 24 16:47:29.821426 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 193/400] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:29 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:30.475944 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7bfae1fc-3b33-409c-9456-a309baa6e287 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:30.477213 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7bfae1fc-3b33-409c-9456-a309baa6e287 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:30.483996 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bfae1fc-3b33-409c-9456-a309baa6e287 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:30.484507 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bfae1fc-3b33-409c-9456-a309baa6e287 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:30.484935 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bfae1fc-3b33-409c-9456-a309baa6e287 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:30.485795 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bfae1fc-3b33-409c-9456-a309baa6e287 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:30.486087 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bfae1fc-3b33-409c-9456-a309baa6e287 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:30.486508 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bfae1fc-3b33-409c-9456-a309baa6e287 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:30.631905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7bfae1fc-3b33-409c-9456-a309baa6e287 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:30.641037 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7bfae1fc-3b33-409c-9456-a309baa6e287 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.169760 Aug 24 16:47:30.641807 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 208/401] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:30 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:30.843716 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:30.844561 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:30.853313 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:30.853796 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:30.857052 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:30.857052 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:30.857052 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:30.857052 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:31.006196 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:31.014742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:31.016237 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:31.017432 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-aff716f6-f6ec-4cbd-b5f3-0df792fd0a1e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.178111 Aug 24 16:47:31.017987 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 194/402] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:30 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:31.665438 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-befa7d70-0d57-4fd1-99a5-2627ce2fcb59 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:31.666805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-befa7d70-0d57-4fd1-99a5-2627ce2fcb59 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:31.673995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-befa7d70-0d57-4fd1-99a5-2627ce2fcb59 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:31.674834 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-befa7d70-0d57-4fd1-99a5-2627ce2fcb59 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:31.675291 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-befa7d70-0d57-4fd1-99a5-2627ce2fcb59 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:31.676064 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-befa7d70-0d57-4fd1-99a5-2627ce2fcb59 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:31.676625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-befa7d70-0d57-4fd1-99a5-2627ce2fcb59 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:31.677138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-befa7d70-0d57-4fd1-99a5-2627ce2fcb59 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:31.817196 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-befa7d70-0d57-4fd1-99a5-2627ce2fcb59 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:31.825918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-befa7d70-0d57-4fd1-99a5-2627ce2fcb59 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.164883 Aug 24 16:47:31.826809 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 209/403] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:31 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:32.042660 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:32.043995 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:32.049831 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:32.052043 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=6 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:32.055627 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:32.062202 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:32.062202 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:32.062202 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:32.062202 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:32.062847 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:32.228382 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:32.244149 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:32.246018 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:32.247323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ff377119-1cad-45f6-a605-0ad9c7510071 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.208576 Aug 24 16:47:32.248791 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 195/404] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:32 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:32.847417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f28e2344-c9a8-4b13-a527-d5063d9e152c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:32.848086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f28e2344-c9a8-4b13-a527-d5063d9e152c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:32.850425 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=8 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:32.855862 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f28e2344-c9a8-4b13-a527-d5063d9e152c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:32.860465 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f28e2344-c9a8-4b13-a527-d5063d9e152c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:32.860465 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f28e2344-c9a8-4b13-a527-d5063d9e152c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:32.860465 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f28e2344-c9a8-4b13-a527-d5063d9e152c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:32.860465 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f28e2344-c9a8-4b13-a527-d5063d9e152c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:32.860827 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f28e2344-c9a8-4b13-a527-d5063d9e152c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:32.999194 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f28e2344-c9a8-4b13-a527-d5063d9e152c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:33.007840 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f28e2344-c9a8-4b13-a527-d5063d9e152c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.164298 Aug 24 16:47:33.008440 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 210/405] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:32 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:33.275701 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:33.276376 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:33.282477 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:33.282956 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:33.283431 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:33.284141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:33.284612 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:33.285033 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:33.429613 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:33.438804 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:33.440397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:33.441710 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-29016c0f-47b4-4e1d-b147-13c2ace71625 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.171178 Aug 24 16:47:33.442284 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 196/406] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:33 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:34.028561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-167bc107-9395-4523-b345-d2c19a21f121 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:34.029171 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-167bc107-9395-4523-b345-d2c19a21f121 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:34.036000 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-167bc107-9395-4523-b345-d2c19a21f121 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:34.037290 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-167bc107-9395-4523-b345-d2c19a21f121 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:34.037691 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-167bc107-9395-4523-b345-d2c19a21f121 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:34.038707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-167bc107-9395-4523-b345-d2c19a21f121 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:34.039186 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-167bc107-9395-4523-b345-d2c19a21f121 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:34.039608 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-167bc107-9395-4523-b345-d2c19a21f121 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:34.179253 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-167bc107-9395-4523-b345-d2c19a21f121 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:34.187100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-167bc107-9395-4523-b345-d2c19a21f121 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.162390 Aug 24 16:47:34.187845 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 211/407] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:34 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:34.465611 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:34.466444 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:34.475301 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:34.475793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:34.476222 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:34.477370 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:34.477893 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:34.478383 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:34.637366 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:34.649395 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:34.655961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:34.655961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2b5b2806-fd41-4942-adf4-b00e6e6c3466 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.190515 Aug 24 16:47:34.655961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 197/408] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:34 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:35.207588 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-eeb7eba6-a7d4-464e-80b6-7a97d4699dc6 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:35.208200 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-eeb7eba6-a7d4-464e-80b6-7a97d4699dc6 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:35.215344 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eeb7eba6-a7d4-464e-80b6-7a97d4699dc6 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:35.215833 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eeb7eba6-a7d4-464e-80b6-7a97d4699dc6 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:35.216263 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eeb7eba6-a7d4-464e-80b6-7a97d4699dc6 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:35.216979 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eeb7eba6-a7d4-464e-80b6-7a97d4699dc6 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:35.217430 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eeb7eba6-a7d4-464e-80b6-7a97d4699dc6 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:35.217849 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eeb7eba6-a7d4-464e-80b6-7a97d4699dc6 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:35.350545 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-eeb7eba6-a7d4-464e-80b6-7a97d4699dc6 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:35.358202 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-eeb7eba6-a7d4-464e-80b6-7a97d4699dc6 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.154477 Aug 24 16:47:35.365282 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 212/409] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:35 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:35.675016 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:35.675627 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:35.682761 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:35.683243 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:35.683679 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:35.684379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:35.684831 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:35.685251 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:35.894965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:35.905278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:35.906776 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:35.908107 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-cb7f8dd2-6c76-495a-b22f-60ed118bbde1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.236946 Aug 24 16:47:35.908684 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 198/410] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:35 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:36.379073 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5cbcbbe3-802e-4035-882e-a3a44fb46bec tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:36.379833 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5cbcbbe3-802e-4035-882e-a3a44fb46bec tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:36.388374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cbcbbe3-802e-4035-882e-a3a44fb46bec tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:36.388859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cbcbbe3-802e-4035-882e-a3a44fb46bec tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:36.389295 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cbcbbe3-802e-4035-882e-a3a44fb46bec tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:36.389998 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cbcbbe3-802e-4035-882e-a3a44fb46bec tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:36.390449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cbcbbe3-802e-4035-882e-a3a44fb46bec tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:36.390870 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cbcbbe3-802e-4035-882e-a3a44fb46bec tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:36.541772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5cbcbbe3-802e-4035-882e-a3a44fb46bec tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:36.549497 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5cbcbbe3-802e-4035-882e-a3a44fb46bec tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.174381 Aug 24 16:47:36.550059 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 213/411] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:36 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:36.597484 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-df391bb6-1ce7-4ab9-a236-28cb494d7771 req-9fa27e08-2e89-4bcb-8fe1-83bc13789f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a600fdc-214e-48d0-9e23-bcb70134d07a", "tag": "e178d836-24a2-4e3a-8f28-a62c7fb35528"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:36.608066 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-df391bb6-1ce7-4ab9-a236-28cb494d7771 req-9fa27e08-2e89-4bcb-8fe1-83bc13789f9e service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:36.608806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-df391bb6-1ce7-4ab9-a236-28cb494d7771 req-9fa27e08-2e89-4bcb-8fe1-83bc13789f9e service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:36.609432 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-df391bb6-1ce7-4ab9-a236-28cb494d7771 req-9fa27e08-2e89-4bcb-8fe1-83bc13789f9e service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:36.621479 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-df391bb6-1ce7-4ab9-a236-28cb494d7771 req-9fa27e08-2e89-4bcb-8fe1-83bc13789f9e service nova] Creating event network-changed:e178d836-24a2-4e3a-8f28-a62c7fb35528 for instance 5a600fdc-214e-48d0-9e23-bcb70134d07a on hv-cinder-73116 Aug 24 16:47:36.626624 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-df391bb6-1ce7-4ab9-a236-28cb494d7771 req-9fa27e08-2e89-4bcb-8fe1-83bc13789f9e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032793 Aug 24 16:47:36.627271 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 199/412] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:36.931819 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:36.932595 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:36.938630 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:36.939116 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:36.939555 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:36.940244 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:36.940722 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:36.941145 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:37.149685 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:37.157898 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:37.159450 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:37.160651 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d3b2be09-6317-4754-a1de-29ceb00248e8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1744 microversion: 2.20 time: 0.233275 Aug 24 16:47:37.161202 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 214/413] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:36 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1744 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:37.572068 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a641607e-8ac6-4f03-bef6-802e32a82f22 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:37.572814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a641607e-8ac6-4f03-bef6-802e32a82f22 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:37.578817 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a641607e-8ac6-4f03-bef6-802e32a82f22 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:37.579294 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a641607e-8ac6-4f03-bef6-802e32a82f22 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:37.579725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a641607e-8ac6-4f03-bef6-802e32a82f22 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:37.580435 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a641607e-8ac6-4f03-bef6-802e32a82f22 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:37.580885 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a641607e-8ac6-4f03-bef6-802e32a82f22 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:37.581302 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a641607e-8ac6-4f03-bef6-802e32a82f22 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:37.599204 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=100 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:37.726739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a641607e-8ac6-4f03-bef6-802e32a82f22 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:37.734499 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a641607e-8ac6-4f03-bef6-802e32a82f22 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.168064 Aug 24 16:47:37.735058 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 200/414] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:37 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:38.185151 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:38.185758 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:38.192052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:38.192569 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:38.192995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:38.193682 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:38.194132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:38.194548 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:38.325058 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:38.333312 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:38.335470 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:38.336689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ae21ad2e-0039-4688-9140-28746263320f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1744 microversion: 2.20 time: 0.155354 Aug 24 16:47:38.337232 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 215/415] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:38 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:38.755631 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-67e1ddd1-5603-458b-80be-33a2582c7fb0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:38.757030 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-67e1ddd1-5603-458b-80be-33a2582c7fb0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:38.763440 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67e1ddd1-5603-458b-80be-33a2582c7fb0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:38.763920 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67e1ddd1-5603-458b-80be-33a2582c7fb0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:38.764365 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67e1ddd1-5603-458b-80be-33a2582c7fb0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:38.765060 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67e1ddd1-5603-458b-80be-33a2582c7fb0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:38.765507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67e1ddd1-5603-458b-80be-33a2582c7fb0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:38.765951 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67e1ddd1-5603-458b-80be-33a2582c7fb0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:38.901057 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-67e1ddd1-5603-458b-80be-33a2582c7fb0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:38.908764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-67e1ddd1-5603-458b-80be-33a2582c7fb0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.156963 Aug 24 16:47:38.917428 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 201/416] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:38 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:39.359845 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:39.360502 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:39.362803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:39.369170 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:39.369653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:39.370087 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:39.370777 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:39.371233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:39.371647 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:39.500443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:39.508499 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:39.509999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:39.511145 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7b0a4e84-27de-44ea-8075-34d6d1b16d92 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1744 microversion: 2.20 time: 0.155239 Aug 24 16:47:39.511703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 216/417] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:39 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:39.930559 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-68309214-1570-4b29-9f7c-7db8e6c66a37 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:39.931142 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-68309214-1570-4b29-9f7c-7db8e6c66a37 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:39.937565 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68309214-1570-4b29-9f7c-7db8e6c66a37 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:39.938047 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68309214-1570-4b29-9f7c-7db8e6c66a37 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:39.938569 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68309214-1570-4b29-9f7c-7db8e6c66a37 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:39.939544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68309214-1570-4b29-9f7c-7db8e6c66a37 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:39.940002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68309214-1570-4b29-9f7c-7db8e6c66a37 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:39.940443 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68309214-1570-4b29-9f7c-7db8e6c66a37 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:39.979980 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c242d877-4d07-47f6-9541-090fab041881 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:39.980856 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c242d877-4d07-47f6-9541-090fab041881 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:39.986984 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c242d877-4d07-47f6-9541-090fab041881 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:39.987485 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c242d877-4d07-47f6-9541-090fab041881 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:39.987907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c242d877-4d07-47f6-9541-090fab041881 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:39.988616 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c242d877-4d07-47f6-9541-090fab041881 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:39.989062 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c242d877-4d07-47f6-9541-090fab041881 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:39.989476 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c242d877-4d07-47f6-9541-090fab041881 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:40.015223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c242d877-4d07-47f6-9541-090fab041881 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4/ips" status: 200 len: 150 microversion: 2.1 time: 0.039453 Aug 24 16:47:40.016566 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 217/418] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 16:47:39 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:47:40.026779 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "177ecf19-aeca-459c-a55a-e1977f7e90c1"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:40.029194 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:40.035228 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:40.035713 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:40.036139 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:40.036881 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:40.037328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:40.037746 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:40.078258 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-68309214-1570-4b29-9f7c-7db8e6c66a37 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:40.091028 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-68309214-1570-4b29-9f7c-7db8e6c66a37 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.161352 Aug 24 16:47:40.091028 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 202/419] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:39 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:40.121831 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Invalid volume: volume 177ecf19-aeca-459c-a55a-e1977f7e90c1 is already attached to instances: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: POST /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4/os-volume_attachments HTTP/1.1 Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 74 Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:47:40.123596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {"volumeAttachment": {"volumeId": "177ecf19-aeca-459c-a55a-e1977f7e90c1"}} Aug 24 16:47:40.125285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Invalid volume: volume 177ecf19-aeca-459c-a55a-e1977f7e90c1 is already attached to instances: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'server_id': 'e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4', 'body': {'volumeAttachment': {'volumeId': '177ecf19-aeca-459c-a55a-e1977f7e90c1'}}} Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 177ecf19-aeca-459c-a55a-e1977f7e90c1 is already attached to instances: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:47:40.126137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 177ecf19-aeca-459c-a55a-e1977f7e90c1 is already attached to instances: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:40.127496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:47:40.132324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:47:40.132324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:47:40.132324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:47:40.132324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 177ecf19-aeca-459c-a55a-e1977f7e90c1 is already attached to instances: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac Aug 24 16:47:40.132324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:47:40.132324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 400 to user: Invalid volume: volume 177ecf19-aeca-459c-a55a-e1977f7e90c1 is already attached to instances: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:47:40.132324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-27ce2f60-657c-43b2-97fe-ccfcc42a624f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102011 Aug 24 16:47:40.132324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 218/420] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:47:40 2022] POST /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 16:47:40.139002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9da64204-8e42-421b-a9ee-06569501e66e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:40.139455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9da64204-8e42-421b-a9ee-06569501e66e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:40.145636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9da64204-8e42-421b-a9ee-06569501e66e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:40.146066 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9da64204-8e42-421b-a9ee-06569501e66e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:40.147175 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9da64204-8e42-421b-a9ee-06569501e66e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:40.147415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9da64204-8e42-421b-a9ee-06569501e66e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:40.147857 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9da64204-8e42-421b-a9ee-06569501e66e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:40.148511 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9da64204-8e42-421b-a9ee-06569501e66e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:40.176427 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9da64204-8e42-421b-a9ee-06569501e66e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Going to try to terminate instance {{(pid=127626) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:47:40.438584 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-09db03a1-6e44-4248-a8e9-0684561d7a42 req-f59a69f2-aa81-42bf-9194-4d6db18411f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eadb4fd-bee8-4fac-b072-550b720e3e95", "name": "network-vif-plugged", "status": "completed", "tag": "9793be94-7c34-443e-80f4-821b2863ba90"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:40.451025 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-09db03a1-6e44-4248-a8e9-0684561d7a42 req-f59a69f2-aa81-42bf-9194-4d6db18411f0 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:40.451658 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-09db03a1-6e44-4248-a8e9-0684561d7a42 req-f59a69f2-aa81-42bf-9194-4d6db18411f0 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:40.452169 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-09db03a1-6e44-4248-a8e9-0684561d7a42 req-f59a69f2-aa81-42bf-9194-4d6db18411f0 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:40.463437 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9da64204-8e42-421b-a9ee-06569501e66e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 204 len: 0 microversion: 2.1 time: 0.328548 Aug 24 16:47:40.464059 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 203/421] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:47:40 2022] DELETE /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:47:40.472301 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-09db03a1-6e44-4248-a8e9-0684561d7a42 req-f59a69f2-aa81-42bf-9194-4d6db18411f0 service nova] Creating event network-vif-plugged:9793be94-7c34-443e-80f4-821b2863ba90 for instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 on hv-cinder-73116 Aug 24 16:47:40.474719 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7ee937fc-1dae-483a-9e12-770b9c8c5287 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:40.477902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7ee937fc-1dae-483a-9e12-770b9c8c5287 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:40.478752 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-09db03a1-6e44-4248-a8e9-0684561d7a42 req-f59a69f2-aa81-42bf-9194-4d6db18411f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047992 Aug 24 16:47:40.479369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 219/422] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:47:40.484767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ee937fc-1dae-483a-9e12-770b9c8c5287 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:40.485281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ee937fc-1dae-483a-9e12-770b9c8c5287 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:40.485710 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ee937fc-1dae-483a-9e12-770b9c8c5287 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:40.486404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ee937fc-1dae-483a-9e12-770b9c8c5287 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:40.486857 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ee937fc-1dae-483a-9e12-770b9c8c5287 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:40.487269 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7ee937fc-1dae-483a-9e12-770b9c8c5287 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:40.534605 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:40.535330 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:40.543333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:40.543830 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:40.544274 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:40.545008 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:40.545460 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:40.545887 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:40.550302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:40.683649 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7ee937fc-1dae-483a-9e12-770b9c8c5287 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:40.687209 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7ee937fc-1dae-483a-9e12-770b9c8c5287 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1682 microversion: 2.1 time: 0.216770 Aug 24 16:47:40.689296 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 204/423] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:40 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:40.739292 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:40.747406 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:40.748917 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:40.750074 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e8c74a19-7a0c-4697-bedc-eb9057c273a1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1739 microversion: 2.20 time: 0.219876 Aug 24 16:47:40.750634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 220/424] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:40 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:47:41.111057 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-217358f1-01bc-4d09-8c7d-227f1e78c05f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:41.112665 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-217358f1-01bc-4d09-8c7d-227f1e78c05f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:41.124413 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-217358f1-01bc-4d09-8c7d-227f1e78c05f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:41.128067 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-217358f1-01bc-4d09-8c7d-227f1e78c05f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:41.128806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-217358f1-01bc-4d09-8c7d-227f1e78c05f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:41.130255 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-217358f1-01bc-4d09-8c7d-227f1e78c05f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:41.132273 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-217358f1-01bc-4d09-8c7d-227f1e78c05f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:41.135721 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-217358f1-01bc-4d09-8c7d-227f1e78c05f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:41.360679 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-217358f1-01bc-4d09-8c7d-227f1e78c05f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:41.360679 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-217358f1-01bc-4d09-8c7d-227f1e78c05f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.239152 Aug 24 16:47:41.360679 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 205/425] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:41 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:41.361033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9cbf0e52-15f7-4c71-a42d-0e5fa8940e03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fffa87d-ce64-4d56-9b6f-1c8e8bb38821"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:41.361033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9cbf0e52-15f7-4c71-a42d-0e5fa8940e03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:41.364847 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9cbf0e52-15f7-4c71-a42d-0e5fa8940e03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:41.365347 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9cbf0e52-15f7-4c71-a42d-0e5fa8940e03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:41.365781 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9cbf0e52-15f7-4c71-a42d-0e5fa8940e03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:41.367013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9cbf0e52-15f7-4c71-a42d-0e5fa8940e03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:41.367463 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9cbf0e52-15f7-4c71-a42d-0e5fa8940e03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:41.367887 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9cbf0e52-15f7-4c71-a42d-0e5fa8940e03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:41.712170 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5efe10eb-a531-405e-8dc3-4f42f4cc79cd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:41.713964 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-5efe10eb-a531-405e-8dc3-4f42f4cc79cd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:41.723579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5efe10eb-a531-405e-8dc3-4f42f4cc79cd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:41.724238 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5efe10eb-a531-405e-8dc3-4f42f4cc79cd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:41.724803 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5efe10eb-a531-405e-8dc3-4f42f4cc79cd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:41.726169 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5efe10eb-a531-405e-8dc3-4f42f4cc79cd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:41.726751 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5efe10eb-a531-405e-8dc3-4f42f4cc79cd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:41.727393 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5efe10eb-a531-405e-8dc3-4f42f4cc79cd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:41.889820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5efe10eb-a531-405e-8dc3-4f42f4cc79cd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:41.906188 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5efe10eb-a531-405e-8dc3-4f42f4cc79cd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1682 microversion: 2.1 time: 0.199368 Aug 24 16:47:41.907084 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 206/426] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:41 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:41.912146 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:41.912779 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:41.922220 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:41.922723 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:41.923160 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:41.923871 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:41.924326 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:41.924764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:42.112458 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:42.122162 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:42.123674 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:42.124874 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9d721a52-fc72-4bd3-8b39-d692910b8114 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1739 microversion: 2.20 time: 0.216852 Aug 24 16:47:42.125434 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 207/427] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:41 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:42.373824 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ad7944d5-3871-46af-aea8-bdf37b9fadcd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:42.374874 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ad7944d5-3871-46af-aea8-bdf37b9fadcd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:42.387628 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7944d5-3871-46af-aea8-bdf37b9fadcd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:42.388695 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7944d5-3871-46af-aea8-bdf37b9fadcd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:42.391883 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7944d5-3871-46af-aea8-bdf37b9fadcd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:42.391883 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7944d5-3871-46af-aea8-bdf37b9fadcd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:42.392813 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7944d5-3871-46af-aea8-bdf37b9fadcd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:42.393520 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7944d5-3871-46af-aea8-bdf37b9fadcd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:42.704510 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ad7944d5-3871-46af-aea8-bdf37b9fadcd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:42.721080 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ad7944d5-3871-46af-aea8-bdf37b9fadcd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.353860 Aug 24 16:47:42.732510 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 208/428] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:42 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:42.746856 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-cae8ee02-4f61-47b1-bf50-bf885b600c3c req-05111c91-fec7-4100-b316-f1ec154a54df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a600fdc-214e-48d0-9e23-bcb70134d07a", "name": "network-vif-plugged", "status": "completed", "tag": "e178d836-24a2-4e3a-8f28-a62c7fb35528"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:42.773482 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-cae8ee02-4f61-47b1-bf50-bf885b600c3c req-05111c91-fec7-4100-b316-f1ec154a54df service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:42.773731 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-cae8ee02-4f61-47b1-bf50-bf885b600c3c req-05111c91-fec7-4100-b316-f1ec154a54df service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:42.778148 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-cae8ee02-4f61-47b1-bf50-bf885b600c3c req-05111c91-fec7-4100-b316-f1ec154a54df service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:42.793107 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-cae8ee02-4f61-47b1-bf50-bf885b600c3c req-05111c91-fec7-4100-b316-f1ec154a54df service nova] Creating event network-vif-plugged:e178d836-24a2-4e3a-8f28-a62c7fb35528 for instance 5a600fdc-214e-48d0-9e23-bcb70134d07a on hv-cinder-73116 Aug 24 16:47:42.800280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-cae8ee02-4f61-47b1-bf50-bf885b600c3c req-05111c91-fec7-4100-b316-f1ec154a54df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066288 Aug 24 16:47:42.800987 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 209/429] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:42.930349 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0d1400e7-840d-46cd-bc10-c8e75ab9031f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:42.931253 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0d1400e7-840d-46cd-bc10-c8e75ab9031f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:42.938314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0d1400e7-840d-46cd-bc10-c8e75ab9031f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:42.938934 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0d1400e7-840d-46cd-bc10-c8e75ab9031f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:42.939982 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0d1400e7-840d-46cd-bc10-c8e75ab9031f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:42.940121 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0d1400e7-840d-46cd-bc10-c8e75ab9031f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:42.940510 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0d1400e7-840d-46cd-bc10-c8e75ab9031f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:42.940929 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0d1400e7-840d-46cd-bc10-c8e75ab9031f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:43.111040 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9cbf0e52-15f7-4c71-a42d-0e5fa8940e03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "POST /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.758516 Aug 24 16:47:43.123737 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 221/430] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:47:41 2022] POST /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments => generated 194 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:43.154705 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:43.155843 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:43.200294 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:43.203418 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:43.212102 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:43.212894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:43.213491 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:43.213778 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:43.363465 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0d1400e7-840d-46cd-bc10-c8e75ab9031f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:43.379513 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0d1400e7-840d-46cd-bc10-c8e75ab9031f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1682 microversion: 2.1 time: 0.455002 Aug 24 16:47:43.380119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 210/431] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:42 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1682 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:43.577721 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:43.588097 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:43.590127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:43.591361 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e3f40e2d-87ad-4f58-a3aa-b8a0d419b15c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1739 microversion: 2.20 time: 0.441879 Aug 24 16:47:43.591929 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 222/432] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:43 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1739 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:43.742793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-567c5361-2911-49d1-8212-f7d7725634be tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:43.743292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-567c5361-2911-49d1-8212-f7d7725634be tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:43.750099 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-567c5361-2911-49d1-8212-f7d7725634be tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:43.750743 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-567c5361-2911-49d1-8212-f7d7725634be tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:43.751178 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-567c5361-2911-49d1-8212-f7d7725634be tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:43.751878 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-567c5361-2911-49d1-8212-f7d7725634be tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:43.752325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-567c5361-2911-49d1-8212-f7d7725634be tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:43.752765 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-567c5361-2911-49d1-8212-f7d7725634be tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:43.892129 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-567c5361-2911-49d1-8212-f7d7725634be tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:43.902049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-567c5361-2911-49d1-8212-f7d7725634be tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.163472 Aug 24 16:47:43.902487 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 211/433] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:43 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:44.405019 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4a96defd-e457-4264-bcfa-8ae4b559426a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:44.405643 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4a96defd-e457-4264-bcfa-8ae4b559426a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:44.411597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a96defd-e457-4264-bcfa-8ae4b559426a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:44.412077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a96defd-e457-4264-bcfa-8ae4b559426a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:44.412638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a96defd-e457-4264-bcfa-8ae4b559426a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:44.413276 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a96defd-e457-4264-bcfa-8ae4b559426a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:44.413870 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a96defd-e457-4264-bcfa-8ae4b559426a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:44.414789 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a96defd-e457-4264-bcfa-8ae4b559426a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:44.545802 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4a96defd-e457-4264-bcfa-8ae4b559426a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:44.545802 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4a96defd-e457-4264-bcfa-8ae4b559426a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1614 microversion: 2.1 time: 0.124032 Aug 24 16:47:44.545802 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 223/434] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:44 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1614 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:44.614727 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:44.620175 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:44.625070 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:44.625928 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:44.626607 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:44.628490 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:44.629180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:44.629670 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:44.821684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-14ad42f1-5def-49c4-b649-d93241055329 req-e266f911-48ab-472d-a914-c56c08f50bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4", "name": "network-vif-deleted", "tag": "8f12eb4e-a077-4950-8f49-746c7b5d2410"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:44.821684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-14ad42f1-5def-49c4-b649-d93241055329 req-e266f911-48ab-472d-a914-c56c08f50bbd service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:44.821684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-14ad42f1-5def-49c4-b649-d93241055329 req-e266f911-48ab-472d-a914-c56c08f50bbd service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:44.821684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-14ad42f1-5def-49c4-b649-d93241055329 req-e266f911-48ab-472d-a914-c56c08f50bbd service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:44.829466 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-14ad42f1-5def-49c4-b649-d93241055329 req-e266f911-48ab-472d-a914-c56c08f50bbd service nova] Creating event network-vif-deleted:8f12eb4e-a077-4950-8f49-746c7b5d2410 for instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 on hv-cinder-73116 Aug 24 16:47:44.843479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-14ad42f1-5def-49c4-b649-d93241055329 req-e266f911-48ab-472d-a914-c56c08f50bbd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063429 Aug 24 16:47:44.847015 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 224/435] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:44.903626 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:44.917628 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:44.920448 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:44.922017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-fe1f334c-c9fc-4ef8-8e48-95a0e9e958ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1739 microversion: 2.20 time: 0.311163 Aug 24 16:47:44.922864 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 212/436] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:44 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:44.929708 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5d17d21e-be53-4960-b440-9ab3717add3a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:44.931579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5d17d21e-be53-4960-b440-9ab3717add3a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:44.938406 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d17d21e-be53-4960-b440-9ab3717add3a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:44.938903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d17d21e-be53-4960-b440-9ab3717add3a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:44.939397 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d17d21e-be53-4960-b440-9ab3717add3a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:44.940112 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d17d21e-be53-4960-b440-9ab3717add3a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:44.940601 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d17d21e-be53-4960-b440-9ab3717add3a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:44.941029 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d17d21e-be53-4960-b440-9ab3717add3a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:45.135346 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5d17d21e-be53-4960-b440-9ab3717add3a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:45.146420 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5d17d21e-be53-4960-b440-9ab3717add3a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1358 microversion: 2.1 time: 0.221919 Aug 24 16:47:45.147430 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 225/437] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:44 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:45.546282 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-95901fd3-1b8b-4a0a-8ba9-88b75178c8c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:45.547201 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-95901fd3-1b8b-4a0a-8ba9-88b75178c8c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:45.556017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95901fd3-1b8b-4a0a-8ba9-88b75178c8c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:45.557462 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95901fd3-1b8b-4a0a-8ba9-88b75178c8c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:45.557929 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95901fd3-1b8b-4a0a-8ba9-88b75178c8c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:45.558641 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95901fd3-1b8b-4a0a-8ba9-88b75178c8c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:45.559103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95901fd3-1b8b-4a0a-8ba9-88b75178c8c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:45.559962 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-95901fd3-1b8b-4a0a-8ba9-88b75178c8c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:45.686253 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-95901fd3-1b8b-4a0a-8ba9-88b75178c8c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:45.709017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-95901fd3-1b8b-4a0a-8ba9-88b75178c8c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1326 microversion: 2.1 time: 0.155608 Aug 24 16:47:45.709017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 213/438] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:45 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1326 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:45.947094 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:45.949850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:45.964618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:45.968450 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:45.969359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:45.972319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:45.974310 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:45.975114 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.178233 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-385bf9b9-e3a4-4591-b296-d8099c971ebb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:46.179322 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-385bf9b9-e3a4-4591-b296-d8099c971ebb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:46.191627 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-385bf9b9-e3a4-4591-b296-d8099c971ebb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.192046 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-385bf9b9-e3a4-4591-b296-d8099c971ebb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.192527 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-385bf9b9-e3a4-4591-b296-d8099c971ebb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.193256 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-385bf9b9-e3a4-4591-b296-d8099c971ebb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.193719 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-385bf9b9-e3a4-4591-b296-d8099c971ebb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.194153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-385bf9b9-e3a4-4591-b296-d8099c971ebb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.255956 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:46.265706 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:46.268276 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:46.271697 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-71a70e23-69e2-4f92-9c20-7032d48121a7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1739 microversion: 2.20 time: 0.330019 Aug 24 16:47:46.274584 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 226/439] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:45 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:46.515253 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-385bf9b9-e3a4-4591-b296-d8099c971ebb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:46.535590 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-385bf9b9-e3a4-4591-b296-d8099c971ebb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1549 microversion: 2.1 time: 0.360824 Aug 24 16:47:46.556629 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 214/440] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:46 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1549 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:46.563680 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a881f286-d9d7-4f56-bc6f-b4af55d69d66 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:46.564445 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a881f286-d9d7-4f56-bc6f-b4af55d69d66 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:46.575410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a881f286-d9d7-4f56-bc6f-b4af55d69d66 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.576076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a881f286-d9d7-4f56-bc6f-b4af55d69d66 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.576623 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a881f286-d9d7-4f56-bc6f-b4af55d69d66 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.577556 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a881f286-d9d7-4f56-bc6f-b4af55d69d66 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.581782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a881f286-d9d7-4f56-bc6f-b4af55d69d66 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.582382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a881f286-d9d7-4f56-bc6f-b4af55d69d66 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.722492 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:46.723557 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:46.741713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.742453 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.743294 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.744306 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.744961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.745770 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.784906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.785736 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.786319 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.787082 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lazy-loading 'fault' on Instance uuid e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:47:46.797595 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a881f286-d9d7-4f56-bc6f-b4af55d69d66 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:46.821430 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a881f286-d9d7-4f56-bc6f-b4af55d69d66 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1549 microversion: 2.1 time: 0.247793 Aug 24 16:47:46.821430 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 227/441] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:46 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1549 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:46.838289 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8da1d15c-d1ba-4d43-ba56-232d8a62f1c9 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:46.846435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8da1d15c-d1ba-4d43-ba56-232d8a62f1c9 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:46.847341 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8da1d15c-d1ba-4d43-ba56-232d8a62f1c9 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Searching by: {'deleted': False, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10'} {{(pid=127627) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 16:47:46.859615 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8da1d15c-d1ba-4d43-ba56-232d8a62f1c9 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.860967 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8da1d15c-d1ba-4d43-ba56-232d8a62f1c9 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.865140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8da1d15c-d1ba-4d43-ba56-232d8a62f1c9 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.870905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8da1d15c-d1ba-4d43-ba56-232d8a62f1c9 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.873691 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8da1d15c-d1ba-4d43-ba56-232d8a62f1c9 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.874350 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8da1d15c-d1ba-4d43-ba56-232d8a62f1c9 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.875943 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:46.879841 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:46.899544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5777008f-45cb-4b85-b487-22ef5c1712ef tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 200 len: 1331 microversion: 2.1 time: 0.176162 Aug 24 16:47:46.900678 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 215/442] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:46 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 1331 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:47.009626 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.multi_cell_list [None req-8da1d15c-d1ba-4d43-ba56-232d8a62f1c9 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127627) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 16:47:47.117073 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8da1d15c-d1ba-4d43-ba56-232d8a62f1c9 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.283660 Aug 24 16:47:47.119723 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 228/443] 10.222.0.17 () {58 vars in 1125 bytes} [Wed Aug 24 16:47:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:47.130010 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0df8f550-b1d3-4aaa-9db6-2c7591adfb04 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:47.130624 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0df8f550-b1d3-4aaa-9db6-2c7591adfb04 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:47.137287 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0df8f550-b1d3-4aaa-9db6-2c7591adfb04 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:47.137776 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0df8f550-b1d3-4aaa-9db6-2c7591adfb04 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:47.138461 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0df8f550-b1d3-4aaa-9db6-2c7591adfb04 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:47.139626 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0df8f550-b1d3-4aaa-9db6-2c7591adfb04 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:47.140269 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0df8f550-b1d3-4aaa-9db6-2c7591adfb04 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:47.140878 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0df8f550-b1d3-4aaa-9db6-2c7591adfb04 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:47.301390 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:47.302508 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:47.306439 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0df8f550-b1d3-4aaa-9db6-2c7591adfb04 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:47.313780 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:47.314279 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:47.314415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0df8f550-b1d3-4aaa-9db6-2c7591adfb04 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1549 microversion: 2.1 time: 0.188136 Aug 24 16:47:47.314719 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:47.314832 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 216/444] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:47 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:47.317019 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:47.317695 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:47.318328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:47.487445 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:47.515069 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:47.571703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:47.571703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8ab347d9-ae92-4be1-a9ac-9fad7fc04abc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1739 microversion: 2.20 time: 0.262594 Aug 24 16:47:47.571703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 229/445] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:47 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:47:47.923176 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:47.923992 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:47.926483 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:47.931956 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:47.932547 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:47.933191 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:47.933922 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:47.934659 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:47.934988 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:47.949782 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 HTTP/1.1 Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:47:47.951894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:47:47.962592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': 'e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4'} Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:47:47.965281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:47:47.967904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:47:47.971330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:47:47.971330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d0d560a8-4a32-499b-8146-ee41fae9f656 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 404 len: 111 microversion: 2.1 time: 0.034041 Aug 24 16:47:47.971330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 217/446] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:47 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:47:47.971769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3e2dcbec-c82a-4d5f-9b8a-cfa1d3074b7d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '.version_select at 0x7f06a77b2f70>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:48.072677 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3e2dcbec-c82a-4d5f-9b8a-cfa1d3074b7d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394085887" status: 202 len: 0 microversion: 2.1 time: 0.113162 Aug 24 16:47:48.075364 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 230/447] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 24 16:47:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394085887 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:47:48.613762 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:48.614364 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:48.621803 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:48.622280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:48.622709 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:48.623394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:48.623839 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:48.624261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:48.928376 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:48.939854 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:48.943603 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:48.943603 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3684e8ef-d50a-4959-9745-13c7bc55afa6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1739 microversion: 2.20 time: 0.333423 Aug 24 16:47:48.943861 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 218/448] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:48 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:49.531362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-27464c4e-f6f2-47e6-966d-631f07363821 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:49.534607 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-27464c4e-f6f2-47e6-966d-631f07363821 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:49.543905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27464c4e-f6f2-47e6-966d-631f07363821 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:49.544524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27464c4e-f6f2-47e6-966d-631f07363821 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:49.545346 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27464c4e-f6f2-47e6-966d-631f07363821 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:49.546405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27464c4e-f6f2-47e6-966d-631f07363821 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:49.547098 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27464c4e-f6f2-47e6-966d-631f07363821 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:49.547733 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27464c4e-f6f2-47e6-966d-631f07363821 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:49.694447 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-27464c4e-f6f2-47e6-966d-631f07363821 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lazy-loading 'services' on Instance uuid 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:47:49.703503 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-40d031f3-b8d6-4e68-a003-210ab279248d tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8167ef3c-de45-476b-a1a1-dc8a38563ac6"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:49.706514 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-40d031f3-b8d6-4e68-a003-210ab279248d tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:49.712767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40d031f3-b8d6-4e68-a003-210ab279248d tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:49.713502 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40d031f3-b8d6-4e68-a003-210ab279248d tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:49.713938 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40d031f3-b8d6-4e68-a003-210ab279248d tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:49.714815 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40d031f3-b8d6-4e68-a003-210ab279248d tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:49.715511 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40d031f3-b8d6-4e68-a003-210ab279248d tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:49.716089 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40d031f3-b8d6-4e68-a003-210ab279248d tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:49.991727 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-27464c4e-f6f2-47e6-966d-631f07363821 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments/177ecf19-aeca-459c-a55a-e1977f7e90c1" status: 202 len: 0 microversion: 2.1 time: 0.465528 Aug 24 16:47:49.992814 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 231/449] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:47:49 2022] DELETE /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments/177ecf19-aeca-459c-a55a-e1977f7e90c1 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:47:50.002912 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:50.003849 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:50.012710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:50.013416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:50.014009 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:50.015276 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:50.016094 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:50.016709 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:50.186510 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:50.197707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:50.199716 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:50.201398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3be4b9dc-24be-4809-9c28-2765e4701e9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1739 microversion: 2.20 time: 0.203354 Aug 24 16:47:50.202408 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 232/450] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:49 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:50.208127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4504f139-3012-4a0e-92ed-ca0eaf9e2828 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:50.211535 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4504f139-3012-4a0e-92ed-ca0eaf9e2828 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:50.217932 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4504f139-3012-4a0e-92ed-ca0eaf9e2828 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:50.218668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4504f139-3012-4a0e-92ed-ca0eaf9e2828 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:50.219333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4504f139-3012-4a0e-92ed-ca0eaf9e2828 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:50.220356 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4504f139-3012-4a0e-92ed-ca0eaf9e2828 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:50.221046 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4504f139-3012-4a0e-92ed-ca0eaf9e2828 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:50.221652 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4504f139-3012-4a0e-92ed-ca0eaf9e2828 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:50.256203 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4504f139-3012-4a0e-92ed-ca0eaf9e2828 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052479 Aug 24 16:47:50.256749 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 233/451] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:47:50 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:50.592409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-40d031f3-b8d6-4e68-a003-210ab279248d tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "POST /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893185 Aug 24 16:47:50.593168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 219/452] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:47:49 2022] POST /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments => generated 194 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:47:51.226194 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:51.228054 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:51.235242 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:51.235826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:51.236334 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:51.237145 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:51.237652 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:51.238164 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:51.270852 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7816d351-a938-47c9-910a-f0ccbfbc8339 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:51.273632 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7816d351-a938-47c9-910a-f0ccbfbc8339 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:51.282501 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7816d351-a938-47c9-910a-f0ccbfbc8339 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:51.283283 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7816d351-a938-47c9-910a-f0ccbfbc8339 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:51.283749 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7816d351-a938-47c9-910a-f0ccbfbc8339 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:51.284684 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7816d351-a938-47c9-910a-f0ccbfbc8339 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:51.285295 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7816d351-a938-47c9-910a-f0ccbfbc8339 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:51.285878 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7816d351-a938-47c9-910a-f0ccbfbc8339 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:51.322325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7816d351-a938-47c9-910a-f0ccbfbc8339 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056108 Aug 24 16:47:51.327146 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 220/453] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:47:51 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:47:51.390946 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:51.401910 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:51.403359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:51.404776 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6a85077e-287f-4884-b2e8-b81b1cea37cf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1739 microversion: 2.20 time: 0.182662 Aug 24 16:47:51.410235 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 234/454] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:51 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:52.334862 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-499188a3-ef91-4678-b5d4-bc350fb694e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:52.339020 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-499188a3-ef91-4678-b5d4-bc350fb694e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:52.346461 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-499188a3-ef91-4678-b5d4-bc350fb694e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:52.347321 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-499188a3-ef91-4678-b5d4-bc350fb694e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:52.348002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-499188a3-ef91-4678-b5d4-bc350fb694e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:52.348809 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-499188a3-ef91-4678-b5d4-bc350fb694e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:52.349345 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-499188a3-ef91-4678-b5d4-bc350fb694e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:52.349840 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-499188a3-ef91-4678-b5d4-bc350fb694e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:52.384098 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-499188a3-ef91-4678-b5d4-bc350fb694e4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052858 Aug 24 16:47:52.385123 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 221/455] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:47:52 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:52.428206 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:52.429747 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:52.437216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:52.437932 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:52.438548 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:52.439711 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:52.440513 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:52.440994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:52.590898 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:52.599929 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:52.601643 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:52.603570 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fa64f27c-ff3e-4a2a-bfab-35580f652d9e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1739 microversion: 2.20 time: 0.179221 Aug 24 16:47:52.604223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 235/456] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:52 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:53.150286 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8bf0d495-7b5e-4b9b-934d-7630f5f47474 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:53.152496 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8bf0d495-7b5e-4b9b-934d-7630f5f47474 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:53.158629 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bf0d495-7b5e-4b9b-934d-7630f5f47474 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.159208 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bf0d495-7b5e-4b9b-934d-7630f5f47474 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.159677 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bf0d495-7b5e-4b9b-934d-7630f5f47474 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.160399 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bf0d495-7b5e-4b9b-934d-7630f5f47474 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.160882 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bf0d495-7b5e-4b9b-934d-7630f5f47474 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.161334 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bf0d495-7b5e-4b9b-934d-7630f5f47474 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.187166 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-8bf0d495-7b5e-4b9b-934d-7630f5f47474 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lazy-loading 'flavor' on Instance uuid f4e8d907-5a6d-450e-92bc-a4ee16bde539 {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:47:53.398250 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-689262b6-c892-4bc1-a6c5-237e85f40d58 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:53.401910 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-689262b6-c892-4bc1-a6c5-237e85f40d58 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:53.408994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-689262b6-c892-4bc1-a6c5-237e85f40d58 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.409588 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-689262b6-c892-4bc1-a6c5-237e85f40d58 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.410127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-689262b6-c892-4bc1-a6c5-237e85f40d58 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.410950 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-689262b6-c892-4bc1-a6c5-237e85f40d58 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.411488 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-689262b6-c892-4bc1-a6c5-237e85f40d58 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.412017 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-689262b6-c892-4bc1-a6c5-237e85f40d58 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.417514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:53.447866 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-689262b6-c892-4bc1-a6c5-237e85f40d58 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053990 Aug 24 16:47:53.448697 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 236/457] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:47:53 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:53.607532 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8bf0d495-7b5e-4b9b-934d-7630f5f47474 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "POST /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/action" status: 200 len: 32 microversion: 2.1 time: 0.461175 Aug 24 16:47:53.608418 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 222/458] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:47:53 2022] POST /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/action => generated 32 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:47:53.618511 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bc7812f3-36b8-414b-a00a-486a0c546c0f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:53.619125 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bc7812f3-36b8-414b-a00a-486a0c546c0f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:53.626580 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc7812f3-36b8-414b-a00a-486a0c546c0f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.627299 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc7812f3-36b8-414b-a00a-486a0c546c0f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.627921 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc7812f3-36b8-414b-a00a-486a0c546c0f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.628227 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:53.629065 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc7812f3-36b8-414b-a00a-486a0c546c0f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.629187 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:53.634032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc7812f3-36b8-414b-a00a-486a0c546c0f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.634032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc7812f3-36b8-414b-a00a-486a0c546c0f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.637709 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.638198 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.638637 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.639342 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.639928 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.640634 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.834900 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:53.837484 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bc7812f3-36b8-414b-a00a-486a0c546c0f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:53.866063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bc7812f3-36b8-414b-a00a-486a0c546c0f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.251988 Aug 24 16:47:53.869570 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:53.871429 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:53.872722 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-df23d02f-a091-4ceb-b27d-66847899ba6e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1739 microversion: 2.20 time: 0.249573 Aug 24 16:47:53.873492 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 223/459] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:53 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:47:53.880958 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 237/460] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:53 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:54.459938 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-cc0520ce-494a-4d95-9933-aa63586c05ac tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:54.462927 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-cc0520ce-494a-4d95-9933-aa63586c05ac tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:54.469406 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc0520ce-494a-4d95-9933-aa63586c05ac tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.469966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc0520ce-494a-4d95-9933-aa63586c05ac tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.470409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc0520ce-494a-4d95-9933-aa63586c05ac tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.471112 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc0520ce-494a-4d95-9933-aa63586c05ac tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.471565 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc0520ce-494a-4d95-9933-aa63586c05ac tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.471990 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cc0520ce-494a-4d95-9933-aa63586c05ac tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.502686 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-cc0520ce-494a-4d95-9933-aa63586c05ac tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046487 Aug 24 16:47:54.503181 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 224/461] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:47:54 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:47:54.573139 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5a0134b6-70dc-4ce5-9768-0dbc46beec7f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:54.573705 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5a0134b6-70dc-4ce5-9768-0dbc46beec7f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:54.580140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a0134b6-70dc-4ce5-9768-0dbc46beec7f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.580758 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a0134b6-70dc-4ce5-9768-0dbc46beec7f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.581254 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a0134b6-70dc-4ce5-9768-0dbc46beec7f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.582065 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a0134b6-70dc-4ce5-9768-0dbc46beec7f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.582601 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a0134b6-70dc-4ce5-9768-0dbc46beec7f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.583082 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a0134b6-70dc-4ce5-9768-0dbc46beec7f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.610209 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5a0134b6-70dc-4ce5-9768-0dbc46beec7f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:47:54.888704 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7a27df47-f1ee-46ac-9894-9ec5070136be tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:54.889467 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7a27df47-f1ee-46ac-9894-9ec5070136be tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:54.895961 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5a0134b6-70dc-4ce5-9768-0dbc46beec7f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 204 len: 0 microversion: 2.1 time: 0.327543 Aug 24 16:47:54.902155 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 238/462] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:47:54 2022] DELETE /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:47:54.907451 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7a27df47-f1ee-46ac-9894-9ec5070136be tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.923619 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:54.924491 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7a27df47-f1ee-46ac-9894-9ec5070136be tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.925028 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7a27df47-f1ee-46ac-9894-9ec5070136be tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.925849 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7a27df47-f1ee-46ac-9894-9ec5070136be tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.926634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:54.928969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7a27df47-f1ee-46ac-9894-9ec5070136be tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.932650 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7a27df47-f1ee-46ac-9894-9ec5070136be tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.939974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.941247 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.941247 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.941710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.942162 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.942579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:55.151219 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7a27df47-f1ee-46ac-9894-9ec5070136be tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:55.154180 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:55.162293 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7a27df47-f1ee-46ac-9894-9ec5070136be tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.278295 Aug 24 16:47:55.162484 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:55.163182 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 225/463] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:54 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:55.163886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:55.165274 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5cb51992-a3a1-4a39-8e00-5ac573a2f306 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1721 microversion: 2.20 time: 0.264572 Aug 24 16:47:55.165836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 239/464] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:54 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:55.167919 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e3558b0a-9241-4fdb-8b52-cacd17f42760 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:55.168622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e3558b0a-9241-4fdb-8b52-cacd17f42760 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:55.174534 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e3558b0a-9241-4fdb-8b52-cacd17f42760 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:55.175019 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e3558b0a-9241-4fdb-8b52-cacd17f42760 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:55.175448 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e3558b0a-9241-4fdb-8b52-cacd17f42760 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:55.176130 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e3558b0a-9241-4fdb-8b52-cacd17f42760 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:55.176606 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e3558b0a-9241-4fdb-8b52-cacd17f42760 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:55.177060 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e3558b0a-9241-4fdb-8b52-cacd17f42760 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:55.305830 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e3558b0a-9241-4fdb-8b52-cacd17f42760 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:55.313459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e3558b0a-9241-4fdb-8b52-cacd17f42760 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1681 microversion: 2.1 time: 0.149289 Aug 24 16:47:55.314013 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 226/465] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:55 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:56.184958 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-16818084-498f-41dd-9398-569153d360a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:56.185585 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-16818084-498f-41dd-9398-569153d360a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:56.188652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:56.189269 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:56.191690 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16818084-498f-41dd-9398-569153d360a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:56.192179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16818084-498f-41dd-9398-569153d360a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:56.192638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16818084-498f-41dd-9398-569153d360a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:56.193329 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16818084-498f-41dd-9398-569153d360a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:56.193783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16818084-498f-41dd-9398-569153d360a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:56.194207 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16818084-498f-41dd-9398-569153d360a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:56.195226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:56.195704 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:56.196396 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:56.197313 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:56.197775 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:56.198201 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:56.465854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-16818084-498f-41dd-9398-569153d360a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:56.471617 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:56.474412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-16818084-498f-41dd-9398-569153d360a6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.294121 Aug 24 16:47:56.475352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 240/466] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:56 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:56.480825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:56.481023 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-93355979-9f0a-41ed-9ac2-2e65541114a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:56.481548 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-93355979-9f0a-41ed-9ac2-2e65541114a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:56.482522 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:56.483912 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7f261307-6ca3-467a-b4b7-a03b58a2e726 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1721 microversion: 2.20 time: 0.299731 Aug 24 16:47:56.484572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 227/467] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:56 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:47:56.502468 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93355979-9f0a-41ed-9ac2-2e65541114a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:56.502961 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93355979-9f0a-41ed-9ac2-2e65541114a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:56.503499 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93355979-9f0a-41ed-9ac2-2e65541114a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:56.504237 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93355979-9f0a-41ed-9ac2-2e65541114a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:56.504842 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93355979-9f0a-41ed-9ac2-2e65541114a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:56.505157 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93355979-9f0a-41ed-9ac2-2e65541114a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:56.641358 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-93355979-9f0a-41ed-9ac2-2e65541114a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:56.649957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-93355979-9f0a-41ed-9ac2-2e65541114a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1681 microversion: 2.1 time: 0.172891 Aug 24 16:47:56.650683 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 241/468] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:56 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:57.497160 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-bbf88621-1d68-4f81-b92d-a849dcfd4b53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:57.497769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-bbf88621-1d68-4f81-b92d-a849dcfd4b53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:57.504221 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bbf88621-1d68-4f81-b92d-a849dcfd4b53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:57.504733 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bbf88621-1d68-4f81-b92d-a849dcfd4b53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:57.505164 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bbf88621-1d68-4f81-b92d-a849dcfd4b53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:57.505867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bbf88621-1d68-4f81-b92d-a849dcfd4b53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:57.506183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:57.506622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bbf88621-1d68-4f81-b92d-a849dcfd4b53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:57.506732 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bbf88621-1d68-4f81-b92d-a849dcfd4b53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:57.506824 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:57.508880 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:57.514103 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:57.514586 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:57.515023 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:57.515716 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:57.516459 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:57.516888 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:57.702494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-bbf88621-1d68-4f81-b92d-a849dcfd4b53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:57.709141 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:57.710891 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-bbf88621-1d68-4f81-b92d-a849dcfd4b53 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.218242 Aug 24 16:47:57.711473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 228/469] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:57 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:57.716818 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-93ee643d-9293-4c78-ae45-20372648dceb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:57.717429 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-93ee643d-9293-4c78-ae45-20372648dceb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:57.718052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:57.719535 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:57.720708 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4c84a0da-02fc-4f8d-83b4-66493b00298c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1721 microversion: 2.20 time: 0.218414 Aug 24 16:47:57.721414 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 242/470] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:57 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:47:57.723162 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-93ee643d-9293-4c78-ae45-20372648dceb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:57.723646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-93ee643d-9293-4c78-ae45-20372648dceb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:57.724085 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-93ee643d-9293-4c78-ae45-20372648dceb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:57.724801 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-93ee643d-9293-4c78-ae45-20372648dceb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:57.725257 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-93ee643d-9293-4c78-ae45-20372648dceb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:57.725681 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-93ee643d-9293-4c78-ae45-20372648dceb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:57.859720 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-93ee643d-9293-4c78-ae45-20372648dceb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:57.863253 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:57.867830 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-93ee643d-9293-4c78-ae45-20372648dceb tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1681 microversion: 2.1 time: 0.154712 Aug 24 16:47:57.868432 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 229/471] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:57 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:58.516865 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-d38d7b4b-0ced-4350-a59f-6d72b55cefbc req-86bc04db-3cd8-4e75-b720-d1ee54d39999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c63f0ac-d4f8-499f-8901-53d4dbbc15ac", "name": "network-vif-unplugged", "status": "completed", "tag": "fefa6a59-cba3-43bd-99e5-f25c064dc3ea"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:58.528258 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-d38d7b4b-0ced-4350-a59f-6d72b55cefbc req-86bc04db-3cd8-4e75-b720-d1ee54d39999 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:58.528823 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-d38d7b4b-0ced-4350-a59f-6d72b55cefbc req-86bc04db-3cd8-4e75-b720-d1ee54d39999 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:58.529415 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-d38d7b4b-0ced-4350-a59f-6d72b55cefbc req-86bc04db-3cd8-4e75-b720-d1ee54d39999 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:58.540924 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-d38d7b4b-0ced-4350-a59f-6d72b55cefbc req-86bc04db-3cd8-4e75-b720-d1ee54d39999 service nova] Creating event network-vif-unplugged:fefa6a59-cba3-43bd-99e5-f25c064dc3ea for instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac on hv-cinder-73116 Aug 24 16:47:58.546083 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-d38d7b4b-0ced-4350-a59f-6d72b55cefbc req-86bc04db-3cd8-4e75-b720-d1ee54d39999 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033648 Aug 24 16:47:58.546688 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 243/472] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:58.733959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-27aaf42c-5542-46ed-a310-16c0fc1b656f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:58.735217 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-27aaf42c-5542-46ed-a310-16c0fc1b656f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:58.745098 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:58.748318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:58.756846 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:58.759444 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27aaf42c-5542-46ed-a310-16c0fc1b656f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:58.760874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:58.761612 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27aaf42c-5542-46ed-a310-16c0fc1b656f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:58.762309 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27aaf42c-5542-46ed-a310-16c0fc1b656f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:58.762900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:58.763693 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27aaf42c-5542-46ed-a310-16c0fc1b656f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:58.764682 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:58.765236 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27aaf42c-5542-46ed-a310-16c0fc1b656f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:58.765779 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:58.766546 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27aaf42c-5542-46ed-a310-16c0fc1b656f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:58.767050 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:59.039791 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-27aaf42c-5542-46ed-a310-16c0fc1b656f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:59.045202 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:59.052245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-27aaf42c-5542-46ed-a310-16c0fc1b656f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.322541 Aug 24 16:47:59.053091 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 230/473] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:58 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:59.060303 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ab64519e-57b6-4dde-9186-32f5639e0a5b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:59.060680 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ab64519e-57b6-4dde-9186-32f5639e0a5b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:59.066116 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:59.066730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ab64519e-57b6-4dde-9186-32f5639e0a5b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:59.067217 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ab64519e-57b6-4dde-9186-32f5639e0a5b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:59.067656 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ab64519e-57b6-4dde-9186-32f5639e0a5b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:59.067786 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:59.068379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ab64519e-57b6-4dde-9186-32f5639e0a5b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:59.068842 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ab64519e-57b6-4dde-9186-32f5639e0a5b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:59.069267 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ab64519e-57b6-4dde-9186-32f5639e0a5b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:59.071697 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7ea17f32-c1bd-430f-978d-a057e05ee31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1724 microversion: 2.20 time: 0.332303 Aug 24 16:47:59.072537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 244/474] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:47:58 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:59.103290 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-57da3723-c4d5-4018-8e36-814b613962a0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5897f032-0780-41f3-a6b4-97877f9835e4"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:59.107875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-57da3723-c4d5-4018-8e36-814b613962a0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:59.119036 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-57da3723-c4d5-4018-8e36-814b613962a0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:59.119778 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-57da3723-c4d5-4018-8e36-814b613962a0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:59.122362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-57da3723-c4d5-4018-8e36-814b613962a0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:59.122362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-57da3723-c4d5-4018-8e36-814b613962a0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:59.122362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-57da3723-c4d5-4018-8e36-814b613962a0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:59.122848 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-57da3723-c4d5-4018-8e36-814b613962a0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:59.218062 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ab64519e-57b6-4dde-9186-32f5639e0a5b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:59.226764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ab64519e-57b6-4dde-9186-32f5639e0a5b tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1613 microversion: 2.1 time: 0.172699 Aug 24 16:47:59.228291 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 231/475] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:59 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1613 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:59.464553 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-2304a93c-db70-4efb-9bbe-c89c1158ab64 req-9a64310b-338c-4306-9bee-4643890e47b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c63f0ac-d4f8-499f-8901-53d4dbbc15ac", "name": "network-vif-deleted", "tag": "fefa6a59-cba3-43bd-99e5-f25c064dc3ea"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:59.475958 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-2304a93c-db70-4efb-9bbe-c89c1158ab64 req-9a64310b-338c-4306-9bee-4643890e47b6 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:59.476715 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-2304a93c-db70-4efb-9bbe-c89c1158ab64 req-9a64310b-338c-4306-9bee-4643890e47b6 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:59.477291 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-2304a93c-db70-4efb-9bbe-c89c1158ab64 req-9a64310b-338c-4306-9bee-4643890e47b6 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:59.491969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-2304a93c-db70-4efb-9bbe-c89c1158ab64 req-9a64310b-338c-4306-9bee-4643890e47b6 service nova] Creating event network-vif-deleted:fefa6a59-cba3-43bd-99e5-f25c064dc3ea for instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac on hv-cinder-73116 Aug 24 16:47:59.497959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-2304a93c-db70-4efb-9bbe-c89c1158ab64 req-9a64310b-338c-4306-9bee-4643890e47b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038665 Aug 24 16:47:59.498973 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 232/476] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:48:00.083008 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-eabecf1d-d645-4657-9f86-f6ecc6ac483f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:00.089007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-eabecf1d-d645-4657-9f86-f6ecc6ac483f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:00.094036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eabecf1d-d645-4657-9f86-f6ecc6ac483f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.094530 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eabecf1d-d645-4657-9f86-f6ecc6ac483f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.095155 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eabecf1d-d645-4657-9f86-f6ecc6ac483f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:00.095910 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eabecf1d-d645-4657-9f86-f6ecc6ac483f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.096389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eabecf1d-d645-4657-9f86-f6ecc6ac483f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.097107 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eabecf1d-d645-4657-9f86-f6ecc6ac483f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:00.255143 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-eabecf1d-d645-4657-9f86-f6ecc6ac483f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:00.265043 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-eabecf1d-d645-4657-9f86-f6ecc6ac483f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.189300 Aug 24 16:48:00.267849 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 233/477] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:00 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:00.270807 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:00.271593 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:00.278229 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.278702 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.279490 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:00.280391 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.285132 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.285132 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:00.317696 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.318189 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.318626 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:00.319081 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lazy-loading 'fault' on Instance uuid 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:48:00.369805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:00.378129 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8dd79589-eb5f-44de-8801-1f7848bc27c2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 200 len: 1331 microversion: 2.1 time: 0.110839 Aug 24 16:48:00.380841 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 234/478] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:00 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:00.417112 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-57da3723-c4d5-4018-8e36-814b613962a0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "POST /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.321838 Aug 24 16:48:00.417855 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 245/479] 10.222.0.17 () {62 vars in 1364 bytes} [Wed Aug 24 16:47:59 2022] POST /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments => generated 188 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:48:00.556722 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-612f4e47-a81d-4062-b07e-b91256615c0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:00.557322 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-612f4e47-a81d-4062-b07e-b91256615c0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:00.561959 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-e8661238-eb6d-4adf-b89f-0bbce22779eb req-822617d5-18cd-4126-a144-c9ac9bd074c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eadb4fd-bee8-4fac-b072-550b720e3e95", "name": "network-vif-unplugged", "status": "completed", "tag": "9793be94-7c34-443e-80f4-821b2863ba90"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:00.563451 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-612f4e47-a81d-4062-b07e-b91256615c0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.570498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-612f4e47-a81d-4062-b07e-b91256615c0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.570498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-612f4e47-a81d-4062-b07e-b91256615c0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:00.570498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-612f4e47-a81d-4062-b07e-b91256615c0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.570498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-612f4e47-a81d-4062-b07e-b91256615c0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.570839 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-612f4e47-a81d-4062-b07e-b91256615c0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:00.572335 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-e8661238-eb6d-4adf-b89f-0bbce22779eb req-822617d5-18cd-4126-a144-c9ac9bd074c9 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.572837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-e8661238-eb6d-4adf-b89f-0bbce22779eb req-822617d5-18cd-4126-a144-c9ac9bd074c9 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.573262 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-e8661238-eb6d-4adf-b89f-0bbce22779eb req-822617d5-18cd-4126-a144-c9ac9bd074c9 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:00.583948 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.compute.server_external_events [req-e8661238-eb6d-4adf-b89f-0bbce22779eb req-822617d5-18cd-4126-a144-c9ac9bd074c9 service nova] Unable to find a host for instance 1eadb4fd-bee8-4fac-b072-550b720e3e95. Dropping event network-vif-unplugged {{(pid=127627) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 16:48:00.584863 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-e8661238-eb6d-4adf-b89f-0bbce22779eb req-822617d5-18cd-4126-a144-c9ac9bd074c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026700 Aug 24 16:48:00.585622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 246/480] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 16:48:00.613544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-612f4e47-a81d-4062-b07e-b91256615c0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127626) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 16:48:00.932667 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-612f4e47-a81d-4062-b07e-b91256615c0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "POST /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/action" status: 202 len: 0 microversion: 2.20 time: 0.380468 Aug 24 16:48:00.933435 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 235/481] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 24 16:48:00 2022] POST /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:48:00.941764 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:00.942377 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:00.951136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.951649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.952082 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:00.952833 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.953302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.953707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:01.100118 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:01.109821 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:01.111657 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:01.112864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-33b0318a-10a2-4643-802b-3d0aa6e4d39b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1750 microversion: 2.20 time: 0.175096 Aug 24 16:48:01.113428 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 247/482] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:00 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:01.295109 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a73900ef-abc0-4e42-82d4-b4d891d224ee tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:01.296225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a73900ef-abc0-4e42-82d4-b4d891d224ee tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:01.305551 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a73900ef-abc0-4e42-82d4-b4d891d224ee tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:01.306129 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a73900ef-abc0-4e42-82d4-b4d891d224ee tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:01.307263 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a73900ef-abc0-4e42-82d4-b4d891d224ee tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:01.307987 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a73900ef-abc0-4e42-82d4-b4d891d224ee tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:01.308664 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a73900ef-abc0-4e42-82d4-b4d891d224ee tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:01.309297 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a73900ef-abc0-4e42-82d4-b4d891d224ee tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:01.403626 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:01.404153 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:01.413312 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:01.413845 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:01.414642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:01.416149 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:01.416662 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:01.417100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:01.432594 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac HTTP/1.1 Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:48:01.434520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:48:01.435993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '2c63f0ac-d4f8-499f-8901-53d4dbbc15ac'} Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:48:01.436793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:48:01.438267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.439621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:48:01.439621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-735a40e4-8517-414d-946a-d87381b425c0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 404 len: 111 microversion: 2.1 time: 0.038568 Aug 24 16:48:01.441119 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 248/483] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:01 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:48:01.445953 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-28dfe4a7-6dd0-46b8-bd7f-5b8bac6206c8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '.version_select at 0x7f06a75771f0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:01.489424 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a73900ef-abc0-4e42-82d4-b4d891d224ee tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:01.505200 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a73900ef-abc0-4e42-82d4-b4d891d224ee tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.215158 Aug 24 16:48:01.505200 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 236/484] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:01 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:01.511057 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-99efa6fc-a6fc-4497-b47f-0948dd0b9228 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:01.511910 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-99efa6fc-a6fc-4497-b47f-0948dd0b9228 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:01.519929 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99efa6fc-a6fc-4497-b47f-0948dd0b9228 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:01.520443 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99efa6fc-a6fc-4497-b47f-0948dd0b9228 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:01.520883 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99efa6fc-a6fc-4497-b47f-0948dd0b9228 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:01.521580 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99efa6fc-a6fc-4497-b47f-0948dd0b9228 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:01.522037 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99efa6fc-a6fc-4497-b47f-0948dd0b9228 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:01.524566 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99efa6fc-a6fc-4497-b47f-0948dd0b9228 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:01.589838 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-28dfe4a7-6dd0-46b8-bd7f-5b8bac6206c8 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-380955673" status: 202 len: 0 microversion: 2.1 time: 0.146995 Aug 24 16:48:01.590439 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 249/485] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Aug 24 16:48:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-380955673 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:48:01.677649 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-99efa6fc-a6fc-4497-b47f-0948dd0b9228 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:01.687451 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-99efa6fc-a6fc-4497-b47f-0948dd0b9228 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1595 microversion: 2.1 time: 0.181699 Aug 24 16:48:01.692399 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 237/486] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:01 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1595 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:02.137821 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:02.138577 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:02.150573 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:02.151125 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:02.151572 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:02.152311 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:02.158940 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:02.159395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:02.411264 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:02.432254 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:02.436697 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:02.438254 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f357e49c-09ed-4c5d-b445-64803405ba46 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1750 microversion: 2.20 time: 0.304162 Aug 24 16:48:02.438871 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 250/487] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:02 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1750 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:02.532156 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-aabd2d1d-f736-4b7c-9ae0-d7748e44efec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:02.532892 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-aabd2d1d-f736-4b7c-9ae0-d7748e44efec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:02.558196 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aabd2d1d-f736-4b7c-9ae0-d7748e44efec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:02.558772 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aabd2d1d-f736-4b7c-9ae0-d7748e44efec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:02.559230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aabd2d1d-f736-4b7c-9ae0-d7748e44efec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:02.560720 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aabd2d1d-f736-4b7c-9ae0-d7748e44efec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:02.561201 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aabd2d1d-f736-4b7c-9ae0-d7748e44efec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:02.561641 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aabd2d1d-f736-4b7c-9ae0-d7748e44efec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:02.740921 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-960fdf6a-b4f8-4795-a164-134f25472cab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: .version_select at 0x7f06a75778b0>, body: {"keypair": {"name": "tempest-keypair-1210717147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8VjH8txYomqz7LR6zOTOMfa3Iw3ed8tygDOlvNcanKSDKi+hvXyGxlvxpnXaR4LyyEzNDE4KLgXjuVhR/jpHZ6Hb8xF0ZsmumuhN8a3SqxAy2FjHI52em/6tkzwcAFYw=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:02.769406 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-960fdf6a-b4f8-4795-a164-134f25472cab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:48:02.777001 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-960fdf6a-b4f8-4795-a164-134f25472cab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for user 1d9f7755863d45bfb04a1498bd62e367 and project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:48:02.824473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-aabd2d1d-f736-4b7c-9ae0-d7748e44efec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:02.833328 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-aabd2d1d-f736-4b7c-9ae0-d7748e44efec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.309996 Aug 24 16:48:02.834018 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 238/488] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:02 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:02.906528 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-960fdf6a-b4f8-4795-a164-134f25472cab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173586 Aug 24 16:48:02.907636 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 251/489] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 16:48:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:03.462260 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:03.463565 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:03.470653 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:03.471193 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:03.471805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:03.472542 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:03.473104 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:03.473391 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:03.655829 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:03.665255 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:03.667335 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:03.668561 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c63de782-0458-40cc-9520-d1530851e83c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1752 microversion: 2.20 time: 0.210285 Aug 24 16:48:03.669131 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 239/490] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:03 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1752 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:03.858324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d089919a-c16c-44b2-b145-58694861d038 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:03.859119 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d089919a-c16c-44b2-b145-58694861d038 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:03.866516 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d089919a-c16c-44b2-b145-58694861d038 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:03.867295 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d089919a-c16c-44b2-b145-58694861d038 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:03.867735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d089919a-c16c-44b2-b145-58694861d038 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:03.869342 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d089919a-c16c-44b2-b145-58694861d038 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:03.870040 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d089919a-c16c-44b2-b145-58694861d038 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:03.870807 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d089919a-c16c-44b2-b145-58694861d038 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:03.891574 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:04.030911 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d089919a-c16c-44b2-b145-58694861d038 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:04.039745 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d089919a-c16c-44b2-b145-58694861d038 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.186263 Aug 24 16:48:04.040485 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 252/491] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:03 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:04.303711 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-b6e9d1ff-f23b-47e2-aa33-9e8fee8ab3a1 req-a06ffe2d-e8ac-481f-9a5c-5606b5eb4aed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a600fdc-214e-48d0-9e23-bcb70134d07a", "tag": "e178d836-24a2-4e3a-8f28-a62c7fb35528"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:04.316960 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b6e9d1ff-f23b-47e2-aa33-9e8fee8ab3a1 req-a06ffe2d-e8ac-481f-9a5c-5606b5eb4aed service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:04.317764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b6e9d1ff-f23b-47e2-aa33-9e8fee8ab3a1 req-a06ffe2d-e8ac-481f-9a5c-5606b5eb4aed service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:04.318372 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b6e9d1ff-f23b-47e2-aa33-9e8fee8ab3a1 req-a06ffe2d-e8ac-481f-9a5c-5606b5eb4aed service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:04.333742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-b6e9d1ff-f23b-47e2-aa33-9e8fee8ab3a1 req-a06ffe2d-e8ac-481f-9a5c-5606b5eb4aed service nova] Creating event network-changed:e178d836-24a2-4e3a-8f28-a62c7fb35528 for instance 5a600fdc-214e-48d0-9e23-bcb70134d07a on hv-cinder-73116 Aug 24 16:48:04.340584 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-b6e9d1ff-f23b-47e2-aa33-9e8fee8ab3a1 req-a06ffe2d-e8ac-481f-9a5c-5606b5eb4aed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042749 Aug 24 16:48:04.341353 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 240/492] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:04.694568 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:04.695707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:04.706096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:04.707433 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:04.708171 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:04.709484 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:04.710175 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:04.710805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:05.065850 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0ec71664-a37d-424e-a27d-b4eed371f1dd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:05.066633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0ec71664-a37d-424e-a27d-b4eed371f1dd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:05.074203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec71664-a37d-424e-a27d-b4eed371f1dd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:05.074970 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec71664-a37d-424e-a27d-b4eed371f1dd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:05.075496 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec71664-a37d-424e-a27d-b4eed371f1dd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:05.076491 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec71664-a37d-424e-a27d-b4eed371f1dd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:05.077263 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec71664-a37d-424e-a27d-b4eed371f1dd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:05.078197 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec71664-a37d-424e-a27d-b4eed371f1dd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:05.431266 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:05.443762 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:05.451033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:05.454005 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1ed40f91-3666-4a01-bd08-b0a583dc8df3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1752 microversion: 2.20 time: 0.765193 Aug 24 16:48:05.469133 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 253/493] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:04 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1752 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:05.757149 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0ec71664-a37d-424e-a27d-b4eed371f1dd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:05.766202 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0ec71664-a37d-424e-a27d-b4eed371f1dd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.705416 Aug 24 16:48:05.766797 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 241/494] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:05 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:06.404509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5d15072b-dffb-44b6-bc1e-66b2cff0d203 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:06.405013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5d15072b-dffb-44b6-bc1e-66b2cff0d203 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:06.412400 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d15072b-dffb-44b6-bc1e-66b2cff0d203 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:06.412902 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d15072b-dffb-44b6-bc1e-66b2cff0d203 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:06.413346 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d15072b-dffb-44b6-bc1e-66b2cff0d203 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:06.414058 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d15072b-dffb-44b6-bc1e-66b2cff0d203 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:06.414515 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d15072b-dffb-44b6-bc1e-66b2cff0d203 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:06.414941 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d15072b-dffb-44b6-bc1e-66b2cff0d203 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:06.478092 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:06.480310 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:06.489238 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:06.490283 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:06.491127 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:06.492444 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:06.493365 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:06.494596 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:06.534610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-5d15072b-dffb-44b6-bc1e-66b2cff0d203 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lazy-loading 'services' on Instance uuid fcfcc291-21b3-42f0-9398-eeebfa0e9af8 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:48:06.775628 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:06.785125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:06.786656 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:06.787841 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-fc70ee4f-7b9f-4063-bf69-7bdc41b2dc8d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.313842 Aug 24 16:48:06.788435 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 242/495] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:06 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:06.805049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-78ef9268-aa9a-44d9-a6ce-1d1aa450a72d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:06.805049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-78ef9268-aa9a-44d9-a6ce-1d1aa450a72d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:06.805049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78ef9268-aa9a-44d9-a6ce-1d1aa450a72d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:06.805049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78ef9268-aa9a-44d9-a6ce-1d1aa450a72d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:06.805712 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78ef9268-aa9a-44d9-a6ce-1d1aa450a72d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:06.805712 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78ef9268-aa9a-44d9-a6ce-1d1aa450a72d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:06.805712 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78ef9268-aa9a-44d9-a6ce-1d1aa450a72d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:06.805712 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78ef9268-aa9a-44d9-a6ce-1d1aa450a72d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:06.836435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5d15072b-dffb-44b6-bc1e-66b2cff0d203 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/os-volume_attachments/9cd33dbf-d0bc-49f0-a76c-1f7aae7a7258" status: 202 len: 0 microversion: 2.1 time: 0.437280 Aug 24 16:48:06.853598 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 254/496] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:48:06 2022] DELETE /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/os-volume_attachments/9cd33dbf-d0bc-49f0-a76c-1f7aae7a7258 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:48:07.021843 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-78ef9268-aa9a-44d9-a6ce-1d1aa450a72d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:07.031295 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-78ef9268-aa9a-44d9-a6ce-1d1aa450a72d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.241826 Aug 24 16:48:07.031892 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 243/497] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:06 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:07.236608 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1898461062", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "883b1cf6-8114-4681-9877-f2163f4c86c7"}], "security_groups": [{"name": "tempest-securitygroup--1420200227"}], "key_name": "tempest-keypair-1210717147", "user_data": "}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:07.360043 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] validate_networks() for [('883b1cf6-8114-4681-9877-f2163f4c86c7', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:48:07.439219 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d53bbe5b-e01d-4564-9c58-3a8ee4b4f031 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1776266205"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:07.439828 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d53bbe5b-e01d-4564-9c58-3a8ee4b4f031 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:07.462873 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d53bbe5b-e01d-4564-9c58-3a8ee4b4f031 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:07.463737 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d53bbe5b-e01d-4564-9c58-3a8ee4b4f031 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:07.464912 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d53bbe5b-e01d-4564-9c58-3a8ee4b4f031 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:07.465648 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d53bbe5b-e01d-4564-9c58-3a8ee4b4f031 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:07.466117 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d53bbe5b-e01d-4564-9c58-3a8ee4b4f031 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:07.466556 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d53bbe5b-e01d-4564-9c58-3a8ee4b4f031 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:07.712986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:07.955194 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.network.security_group_api [None req-d53bbe5b-e01d-4564-9c58-3a8ee4b4f031 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Adding security group 0ea5fd7c-f51c-4882-ae2d-3e7a1c9d4866 to port e178d836-24a2-4e3a-8f28-a62c7fb35528 Aug 24 16:48:08.214833 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:48:08.215262 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:48:08.215739 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:48:08.216147 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:48:08.216583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:48:08.240804 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:08.241559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:08.241994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:08.242730 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:08.243397 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:08.243825 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:08.268740 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:48:08.274801 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for user 1d9f7755863d45bfb04a1498bd62e367 and project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:48:08.288442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:48:08.297004 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:48:08.452146 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e49317fb-20c4-4cb4-a732-4dfc52945df2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.220659 Aug 24 16:48:08.480490 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 255/498] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:48:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:48:08.499759 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:08.503064 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:08.516819 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:08.517998 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:08.518709 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:08.519706 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:08.520440 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:08.521094 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:08.846888 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:08.886809 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:08.889836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:08.903160 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ddccd397-8827-4c44-9693-406ab233650f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.420256 Aug 24 16:48:08.904509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 256/499] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:08 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:08.920644 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d53bbe5b-e01d-4564-9c58-3a8ee4b4f031 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "POST /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/action" status: 202 len: 0 microversion: 2.1 time: 1.473859 Aug 24 16:48:08.920644 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 244/500] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:48:07 2022] POST /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/action => generated 0 bytes in 1476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:48:08.922299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a8af6880-c85a-4e47-a26e-c1ca95bb4bbb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:08.922857 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a8af6880-c85a-4e47-a26e-c1ca95bb4bbb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:08.935996 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a8af6880-c85a-4e47-a26e-c1ca95bb4bbb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:08.942131 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a8af6880-c85a-4e47-a26e-c1ca95bb4bbb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:08.942738 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a8af6880-c85a-4e47-a26e-c1ca95bb4bbb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:08.943488 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a8af6880-c85a-4e47-a26e-c1ca95bb4bbb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:08.943962 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a8af6880-c85a-4e47-a26e-c1ca95bb4bbb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:08.944413 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a8af6880-c85a-4e47-a26e-c1ca95bb4bbb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:08.954383 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-975014ad-d152-42e2-9939-29832897b9a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:08.955867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-975014ad-d152-42e2-9939-29832897b9a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:09.096436 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-975014ad-d152-42e2-9939-29832897b9a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:09.109385 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-975014ad-d152-42e2-9939-29832897b9a3 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1242 microversion: 2.1 time: 0.174905 Aug 24 16:48:09.110371 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 257/501] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:08 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1242 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:09.115918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-aeb971e4-04ee-4fac-8f51-538cc6c6a304 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:09.116918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-aeb971e4-04ee-4fac-8f51-538cc6c6a304 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:09.124769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aeb971e4-04ee-4fac-8f51-538cc6c6a304 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:09.125572 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aeb971e4-04ee-4fac-8f51-538cc6c6a304 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:09.126373 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aeb971e4-04ee-4fac-8f51-538cc6c6a304 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:09.127674 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aeb971e4-04ee-4fac-8f51-538cc6c6a304 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:09.129071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aeb971e4-04ee-4fac-8f51-538cc6c6a304 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:09.129720 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aeb971e4-04ee-4fac-8f51-538cc6c6a304 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:09.279056 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a8af6880-c85a-4e47-a26e-c1ca95bb4bbb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:09.296826 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a8af6880-c85a-4e47-a26e-c1ca95bb4bbb tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.385335 Aug 24 16:48:09.297950 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 245/502] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:08 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:09.303268 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-a77e5fd1-10df-4a4b-b4ef-92f86cb9e097 req-bbec8405-02a0-4e78-a870-19ee273c307e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a600fdc-214e-48d0-9e23-bcb70134d07a", "tag": "e178d836-24a2-4e3a-8f28-a62c7fb35528"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:09.315721 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-a77e5fd1-10df-4a4b-b4ef-92f86cb9e097 req-bbec8405-02a0-4e78-a870-19ee273c307e service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:09.316176 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-a77e5fd1-10df-4a4b-b4ef-92f86cb9e097 req-bbec8405-02a0-4e78-a870-19ee273c307e service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:09.316781 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-a77e5fd1-10df-4a4b-b4ef-92f86cb9e097 req-bbec8405-02a0-4e78-a870-19ee273c307e service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:09.348689 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-a77e5fd1-10df-4a4b-b4ef-92f86cb9e097 req-bbec8405-02a0-4e78-a870-19ee273c307e service nova] Creating event network-changed:e178d836-24a2-4e3a-8f28-a62c7fb35528 for instance 5a600fdc-214e-48d0-9e23-bcb70134d07a on hv-cinder-73116 Aug 24 16:48:09.367599 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-a77e5fd1-10df-4a4b-b4ef-92f86cb9e097 req-bbec8405-02a0-4e78-a870-19ee273c307e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067687 Aug 24 16:48:09.369004 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 246/503] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:09.440014 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-aeb971e4-04ee-4fac-8f51-538cc6c6a304 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:09.450253 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-aeb971e4-04ee-4fac-8f51-538cc6c6a304 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1760 microversion: 2.1 time: 0.338236 Aug 24 16:48:09.451077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 258/504] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:09 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1760 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:09.943007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:09.943719 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:09.951081 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:09.951573 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:09.952436 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:09.953122 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:09.953574 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:09.961456 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:09.974150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:10.131045 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4fa40627-4c31-44c7-9f1d-ae0fb77e016d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:10.131741 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:10.132126 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4fa40627-4c31-44c7-9f1d-ae0fb77e016d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:10.139785 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4fa40627-4c31-44c7-9f1d-ae0fb77e016d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:10.140419 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4fa40627-4c31-44c7-9f1d-ae0fb77e016d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:10.141376 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4fa40627-4c31-44c7-9f1d-ae0fb77e016d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:10.142372 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4fa40627-4c31-44c7-9f1d-ae0fb77e016d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:10.143311 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4fa40627-4c31-44c7-9f1d-ae0fb77e016d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:10.143928 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4fa40627-4c31-44c7-9f1d-ae0fb77e016d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:10.148467 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:10.151450 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:10.152877 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3e5a0805-4d39-4cec-9bc0-e85b7da2d895 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.214735 Aug 24 16:48:10.156496 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 247/505] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:09 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:10.232677 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4fa40627-4c31-44c7-9f1d-ae0fb77e016d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:10.242374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4fa40627-4c31-44c7-9f1d-ae0fb77e016d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1246 microversion: 2.1 time: 0.114979 Aug 24 16:48:10.243120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 259/506] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:10 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1246 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:10.319614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b2968584-94bb-4c01-8164-74c17ac02a02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:10.320213 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b2968584-94bb-4c01-8164-74c17ac02a02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:10.326666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b2968584-94bb-4c01-8164-74c17ac02a02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:10.327144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b2968584-94bb-4c01-8164-74c17ac02a02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:10.327577 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b2968584-94bb-4c01-8164-74c17ac02a02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:10.328467 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b2968584-94bb-4c01-8164-74c17ac02a02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:10.329309 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b2968584-94bb-4c01-8164-74c17ac02a02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:10.329962 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b2968584-94bb-4c01-8164-74c17ac02a02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:10.478473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b2968584-94bb-4c01-8164-74c17ac02a02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:10.488164 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b2968584-94bb-4c01-8164-74c17ac02a02 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.172868 Aug 24 16:48:10.491605 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 248/507] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:10 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:11.188097 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:11.190129 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:11.207449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:11.207974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:11.208430 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:11.209353 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:11.209653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:11.210076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:11.267846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e40fe728-4f94-4c2f-87f5-8158d85e4f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:11.269051 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e40fe728-4f94-4c2f-87f5-8158d85e4f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:11.282092 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40fe728-4f94-4c2f-87f5-8158d85e4f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:11.286247 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40fe728-4f94-4c2f-87f5-8158d85e4f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:11.287097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40fe728-4f94-4c2f-87f5-8158d85e4f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:11.288011 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40fe728-4f94-4c2f-87f5-8158d85e4f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:11.288691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40fe728-4f94-4c2f-87f5-8158d85e4f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:11.289380 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e40fe728-4f94-4c2f-87f5-8158d85e4f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:11.376725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e40fe728-4f94-4c2f-87f5-8158d85e4f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:11.385838 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e40fe728-4f94-4c2f-87f5-8158d85e4f4f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1246 microversion: 2.1 time: 0.121482 Aug 24 16:48:11.386760 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 249/508] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:11 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1246 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:11.423291 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:11.435115 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:11.437453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:11.438714 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1697a266-ab2a-4a4c-9e3d-b53e534113de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.264980 Aug 24 16:48:11.439836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 260/509] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:11 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:11.514302 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7e868af8-03fe-40de-b7c9-e6050da00348 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:11.515125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7e868af8-03fe-40de-b7c9-e6050da00348 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:11.522318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e868af8-03fe-40de-b7c9-e6050da00348 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:11.522810 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e868af8-03fe-40de-b7c9-e6050da00348 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:11.523249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e868af8-03fe-40de-b7c9-e6050da00348 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:11.523955 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e868af8-03fe-40de-b7c9-e6050da00348 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:11.524539 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e868af8-03fe-40de-b7c9-e6050da00348 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:11.525123 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e868af8-03fe-40de-b7c9-e6050da00348 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:11.686533 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7e868af8-03fe-40de-b7c9-e6050da00348 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:11.699562 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7e868af8-03fe-40de-b7c9-e6050da00348 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.189855 Aug 24 16:48:11.700229 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 250/510] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:11 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:12.409623 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-419857ce-73b4-44e5-986d-d5f60c0490aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:12.410652 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-419857ce-73b4-44e5-986d-d5f60c0490aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:12.417688 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419857ce-73b4-44e5-986d-d5f60c0490aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:12.418296 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419857ce-73b4-44e5-986d-d5f60c0490aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:12.418803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419857ce-73b4-44e5-986d-d5f60c0490aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:12.419580 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419857ce-73b4-44e5-986d-d5f60c0490aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:12.420133 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419857ce-73b4-44e5-986d-d5f60c0490aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:12.420665 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419857ce-73b4-44e5-986d-d5f60c0490aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:12.470034 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:12.470613 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:12.477121 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:12.477604 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:12.478035 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:12.478937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:12.479194 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:12.479875 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:12.492567 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-419857ce-73b4-44e5-986d-d5f60c0490aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:12.501194 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-419857ce-73b4-44e5-986d-d5f60c0490aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1246 microversion: 2.1 time: 0.096159 Aug 24 16:48:12.501790 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 261/511] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:12 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:12.641231 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:12.656073 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:12.657728 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:12.658928 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c361b2f5-a71c-4ba3-a111-18d6e53d5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.192985 Aug 24 16:48:12.659489 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 251/512] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:12 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:12.728845 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-39bf3b04-178c-4aa5-9c00-8fd5e1c6dae9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:12.730017 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-39bf3b04-178c-4aa5-9c00-8fd5e1c6dae9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:12.740249 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39bf3b04-178c-4aa5-9c00-8fd5e1c6dae9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:12.741088 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39bf3b04-178c-4aa5-9c00-8fd5e1c6dae9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:12.741785 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39bf3b04-178c-4aa5-9c00-8fd5e1c6dae9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:12.742951 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39bf3b04-178c-4aa5-9c00-8fd5e1c6dae9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:12.743727 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39bf3b04-178c-4aa5-9c00-8fd5e1c6dae9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:12.745080 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-39bf3b04-178c-4aa5-9c00-8fd5e1c6dae9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:12.920225 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-39bf3b04-178c-4aa5-9c00-8fd5e1c6dae9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:12.929087 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-39bf3b04-178c-4aa5-9c00-8fd5e1c6dae9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.210346 Aug 24 16:48:12.929690 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 262/513] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:12 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:13.524809 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-acbff4d9-f529-4b49-aab6-dc8678c40044 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:13.525683 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-acbff4d9-f529-4b49-aab6-dc8678c40044 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:13.532348 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acbff4d9-f529-4b49-aab6-dc8678c40044 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:13.532867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acbff4d9-f529-4b49-aab6-dc8678c40044 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:13.533301 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acbff4d9-f529-4b49-aab6-dc8678c40044 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:13.534002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acbff4d9-f529-4b49-aab6-dc8678c40044 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:13.534517 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acbff4d9-f529-4b49-aab6-dc8678c40044 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:13.535054 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acbff4d9-f529-4b49-aab6-dc8678c40044 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:13.607665 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-acbff4d9-f529-4b49-aab6-dc8678c40044 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:13.616754 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-acbff4d9-f529-4b49-aab6-dc8678c40044 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1246 microversion: 2.1 time: 0.095940 Aug 24 16:48:13.617347 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 252/514] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:13 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:13.688208 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:13.690197 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:13.702720 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:13.703836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:13.704903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:13.706215 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:13.706859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:13.707499 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:13.861257 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:13.872272 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:13.875641 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:13.877482 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-98a03d82-9e48-487e-ad73-b8f63d7ceb72 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.197528 Aug 24 16:48:13.878275 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 263/515] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:13 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:13.951831 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e719a6f0-c4a0-4552-a6a7-99f6c4d27b3a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:13.952507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e719a6f0-c4a0-4552-a6a7-99f6c4d27b3a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:13.959840 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e719a6f0-c4a0-4552-a6a7-99f6c4d27b3a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:13.960392 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e719a6f0-c4a0-4552-a6a7-99f6c4d27b3a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:13.960833 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e719a6f0-c4a0-4552-a6a7-99f6c4d27b3a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:13.961581 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e719a6f0-c4a0-4552-a6a7-99f6c4d27b3a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:13.962052 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e719a6f0-c4a0-4552-a6a7-99f6c4d27b3a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:13.962718 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e719a6f0-c4a0-4552-a6a7-99f6c4d27b3a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:14.126609 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e719a6f0-c4a0-4552-a6a7-99f6c4d27b3a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:14.136579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e719a6f0-c4a0-4552-a6a7-99f6c4d27b3a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.189113 Aug 24 16:48:14.137466 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 253/516] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:13 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:14.639881 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1d98bf06-b950-42c2-a6e1-b62d77e5af3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:14.640736 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1d98bf06-b950-42c2-a6e1-b62d77e5af3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:14.647806 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d98bf06-b950-42c2-a6e1-b62d77e5af3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:14.655580 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d98bf06-b950-42c2-a6e1-b62d77e5af3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:14.655580 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d98bf06-b950-42c2-a6e1-b62d77e5af3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:14.655580 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d98bf06-b950-42c2-a6e1-b62d77e5af3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:14.655580 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d98bf06-b950-42c2-a6e1-b62d77e5af3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:14.656088 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d98bf06-b950-42c2-a6e1-b62d77e5af3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:14.726987 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1d98bf06-b950-42c2-a6e1-b62d77e5af3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:14.735287 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1d98bf06-b950-42c2-a6e1-b62d77e5af3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1246 microversion: 2.1 time: 0.100803 Aug 24 16:48:14.735876 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 264/517] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:14 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:14.902824 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:14.904167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:14.911676 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:14.912714 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:14.913487 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:14.914277 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:14.914819 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:14.915482 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:15.079727 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:15.090586 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:15.092308 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:15.093561 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-56c5b813-2692-46ab-b7fe-f5631afe2fe6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.196717 Aug 24 16:48:15.096858 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 254/518] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:14 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:15.162078 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e2fd7308-b2d4-46d4-8113-203f64431618 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:15.163112 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e2fd7308-b2d4-46d4-8113-203f64431618 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:15.174614 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2fd7308-b2d4-46d4-8113-203f64431618 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:15.175569 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2fd7308-b2d4-46d4-8113-203f64431618 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:15.175569 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2fd7308-b2d4-46d4-8113-203f64431618 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:15.176261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2fd7308-b2d4-46d4-8113-203f64431618 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:15.176750 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2fd7308-b2d4-46d4-8113-203f64431618 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:15.177177 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2fd7308-b2d4-46d4-8113-203f64431618 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:15.355781 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e2fd7308-b2d4-46d4-8113-203f64431618 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:15.366654 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e2fd7308-b2d4-46d4-8113-203f64431618 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.210566 Aug 24 16:48:15.367644 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 265/519] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:15 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:15.757604 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-06715678-b0db-4170-b9a2-15e4ce198b48 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:15.758385 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-06715678-b0db-4170-b9a2-15e4ce198b48 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:15.765087 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06715678-b0db-4170-b9a2-15e4ce198b48 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:15.765573 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06715678-b0db-4170-b9a2-15e4ce198b48 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:15.766002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06715678-b0db-4170-b9a2-15e4ce198b48 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:15.766715 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06715678-b0db-4170-b9a2-15e4ce198b48 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:15.767166 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06715678-b0db-4170-b9a2-15e4ce198b48 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:15.767588 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06715678-b0db-4170-b9a2-15e4ce198b48 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:15.839441 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-06715678-b0db-4170-b9a2-15e4ce198b48 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:15.847721 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-06715678-b0db-4170-b9a2-15e4ce198b48 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1246 microversion: 2.1 time: 0.094319 Aug 24 16:48:15.862095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 255/520] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:15 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1246 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:16.117658 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:16.118451 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:16.124542 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:16.127449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:16.127449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:16.127449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:16.127449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:16.127854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:16.262014 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:16.271592 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:16.273122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:16.274272 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e3b94a6d-dfc5-4447-87ec-816fb88d5c5f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.160644 Aug 24 16:48:16.274932 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 266/521] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:16 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:16.389356 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e9274c51-1e88-4413-9986-34a29b897992 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:16.390018 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e9274c51-1e88-4413-9986-34a29b897992 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:16.396740 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9274c51-1e88-4413-9986-34a29b897992 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:16.397219 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9274c51-1e88-4413-9986-34a29b897992 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:16.397651 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9274c51-1e88-4413-9986-34a29b897992 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:16.398351 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9274c51-1e88-4413-9986-34a29b897992 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:16.398800 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9274c51-1e88-4413-9986-34a29b897992 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:16.399217 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e9274c51-1e88-4413-9986-34a29b897992 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:16.544180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e9274c51-1e88-4413-9986-34a29b897992 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:16.552565 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e9274c51-1e88-4413-9986-34a29b897992 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.168722 Aug 24 16:48:16.553134 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 256/522] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:16 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:16.868459 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-98307d41-cbda-4c21-b34c-26fab09b82db tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:16.869099 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-98307d41-cbda-4c21-b34c-26fab09b82db tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:16.876130 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98307d41-cbda-4c21-b34c-26fab09b82db tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:16.876650 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98307d41-cbda-4c21-b34c-26fab09b82db tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:16.877078 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98307d41-cbda-4c21-b34c-26fab09b82db tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:16.877771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98307d41-cbda-4c21-b34c-26fab09b82db tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:16.878229 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98307d41-cbda-4c21-b34c-26fab09b82db tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:16.878648 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98307d41-cbda-4c21-b34c-26fab09b82db tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:16.944426 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-98307d41-cbda-4c21-b34c-26fab09b82db tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:16.952098 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-98307d41-cbda-4c21-b34c-26fab09b82db tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1246 microversion: 2.1 time: 0.087504 Aug 24 16:48:16.952691 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 267/523] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:16 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:17.299189 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:17.299804 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:17.306503 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.306953 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.307403 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.308365 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.309129 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.309671 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.575873 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-396363ab-4b43-4217-a694-0feb4e40a51e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:17.576479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-396363ab-4b43-4217-a694-0feb4e40a51e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:17.583244 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-396363ab-4b43-4217-a694-0feb4e40a51e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.583737 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-396363ab-4b43-4217-a694-0feb4e40a51e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.584176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-396363ab-4b43-4217-a694-0feb4e40a51e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.584915 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-396363ab-4b43-4217-a694-0feb4e40a51e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.585377 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-396363ab-4b43-4217-a694-0feb4e40a51e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.585809 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-396363ab-4b43-4217-a694-0feb4e40a51e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.833563 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:17.840145 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-396363ab-4b43-4217-a694-0feb4e40a51e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:17.843234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:17.845390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:17.847834 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5a91526e-5f16-4af5-af4e-f928b50a7113 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.551511 Aug 24 16:48:17.847834 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 257/524] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:17 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:17.849458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-396363ab-4b43-4217-a694-0feb4e40a51e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.279015 Aug 24 16:48:17.850322 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 268/525] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:17 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:17.859280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-bc263c41-d374-49b4-86f1-4905be2b3b99 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:17.865627 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc263c41-d374-49b4-86f1-4905be2b3b99 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.866114 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc263c41-d374-49b4-86f1-4905be2b3b99 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.866554 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc263c41-d374-49b4-86f1-4905be2b3b99 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.927498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-bc263c41-d374-49b4-86f1-4905be2b3b99 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Going to try to stop instance {{(pid=127626) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 16:48:17.972769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-14a4db04-def4-47f7-ac08-4616e5c3baa0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:17.973373 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-14a4db04-def4-47f7-ac08-4616e5c3baa0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:17.979273 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14a4db04-def4-47f7-ac08-4616e5c3baa0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.980002 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14a4db04-def4-47f7-ac08-4616e5c3baa0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.980582 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14a4db04-def4-47f7-ac08-4616e5c3baa0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.981275 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14a4db04-def4-47f7-ac08-4616e5c3baa0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.981724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14a4db04-def4-47f7-ac08-4616e5c3baa0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.982141 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14a4db04-def4-47f7-ac08-4616e5c3baa0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:18.047741 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14a4db04-def4-47f7-ac08-4616e5c3baa0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:18.055891 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-14a4db04-def4-47f7-ac08-4616e5c3baa0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1238 microversion: 2.1 time: 0.086957 Aug 24 16:48:18.056508 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 269/526] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:17 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:18.130113 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-bc263c41-d374-49b4-86f1-4905be2b3b99 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "POST /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/action" status: 202 len: 0 microversion: 2.1 time: 0.281366 Aug 24 16:48:18.130649 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 258/527] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:48:17 2022] POST /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:48:18.139622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c7ebfde5-43e5-4793-857f-92a5c161bf24 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:18.140231 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c7ebfde5-43e5-4793-857f-92a5c161bf24 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:18.146450 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c7ebfde5-43e5-4793-857f-92a5c161bf24 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:18.146935 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c7ebfde5-43e5-4793-857f-92a5c161bf24 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:18.147369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c7ebfde5-43e5-4793-857f-92a5c161bf24 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:18.148054 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c7ebfde5-43e5-4793-857f-92a5c161bf24 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:18.148550 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c7ebfde5-43e5-4793-857f-92a5c161bf24 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:18.148986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c7ebfde5-43e5-4793-857f-92a5c161bf24 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:18.153185 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:18.256769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:18.281362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c7ebfde5-43e5-4793-857f-92a5c161bf24 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:18.289619 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c7ebfde5-43e5-4793-857f-92a5c161bf24 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1678 microversion: 2.1 time: 0.154660 Aug 24 16:48:18.290216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 270/528] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:18 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:18.870986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9ae28b6b-0029-4215-9c76-3bf11f8f91db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:18.871767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:18.872201 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9ae28b6b-0029-4215-9c76-3bf11f8f91db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:18.872314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:18.873846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:18.878392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ae28b6b-0029-4215-9c76-3bf11f8f91db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:18.878883 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ae28b6b-0029-4215-9c76-3bf11f8f91db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:18.879265 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:18.879449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ae28b6b-0029-4215-9c76-3bf11f8f91db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:18.879769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:18.879998 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ae28b6b-0029-4215-9c76-3bf11f8f91db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:18.880210 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:18.880489 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ae28b6b-0029-4215-9c76-3bf11f8f91db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:18.880916 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ae28b6b-0029-4215-9c76-3bf11f8f91db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:18.881095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:18.881424 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:18.881955 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:19.100490 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9ae28b6b-0029-4215-9c76-3bf11f8f91db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:19.108491 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=12 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:19.109462 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:19.111556 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9ae28b6b-0029-4215-9c76-3bf11f8f91db tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.244356 Aug 24 16:48:19.112379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 271/529] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:18 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:19.116724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-250d4501-91e1-42b1-aebd-34ab518cdcee tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:19.117337 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-250d4501-91e1-42b1-aebd-34ab518cdcee tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:19.123937 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-250d4501-91e1-42b1-aebd-34ab518cdcee tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:19.126963 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-250d4501-91e1-42b1-aebd-34ab518cdcee tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:19.126963 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-250d4501-91e1-42b1-aebd-34ab518cdcee tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:19.126963 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-250d4501-91e1-42b1-aebd-34ab518cdcee tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:19.126963 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-250d4501-91e1-42b1-aebd-34ab518cdcee tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:19.127428 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-250d4501-91e1-42b1-aebd-34ab518cdcee tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:19.127550 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:19.128291 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:19.129464 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a051d774-8834-4385-9f14-f1246badb373 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.263275 Aug 24 16:48:19.130018 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 259/530] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:18 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:19.203598 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-250d4501-91e1-42b1-aebd-34ab518cdcee tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:19.211462 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-250d4501-91e1-42b1-aebd-34ab518cdcee tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1294 microversion: 2.1 time: 0.098313 Aug 24 16:48:19.212029 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 272/531] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:19 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:19.315986 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a263083d-9dae-48cf-ad43-c7ee68cb9592 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:19.316790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a263083d-9dae-48cf-ad43-c7ee68cb9592 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:19.323261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a263083d-9dae-48cf-ad43-c7ee68cb9592 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:19.324433 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a263083d-9dae-48cf-ad43-c7ee68cb9592 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:19.325513 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a263083d-9dae-48cf-ad43-c7ee68cb9592 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:19.326259 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a263083d-9dae-48cf-ad43-c7ee68cb9592 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:19.326729 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a263083d-9dae-48cf-ad43-c7ee68cb9592 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:19.327185 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a263083d-9dae-48cf-ad43-c7ee68cb9592 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:19.475346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a263083d-9dae-48cf-ad43-c7ee68cb9592 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:19.483491 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a263083d-9dae-48cf-ad43-c7ee68cb9592 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1678 microversion: 2.1 time: 0.174371 Aug 24 16:48:19.484064 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 260/532] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:19 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:20.133188 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f322bbdb-5218-4ad9-a5b6-682f11e8680d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:20.133796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f322bbdb-5218-4ad9-a5b6-682f11e8680d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:20.141000 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322bbdb-5218-4ad9-a5b6-682f11e8680d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.146692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322bbdb-5218-4ad9-a5b6-682f11e8680d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.146692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322bbdb-5218-4ad9-a5b6-682f11e8680d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.146692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322bbdb-5218-4ad9-a5b6-682f11e8680d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.146692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322bbdb-5218-4ad9-a5b6-682f11e8680d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.147397 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322bbdb-5218-4ad9-a5b6-682f11e8680d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.155396 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:20.155951 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:20.162366 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.162853 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.163285 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.163977 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.164455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.173762 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.468253 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f322bbdb-5218-4ad9-a5b6-682f11e8680d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:20.476669 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f322bbdb-5218-4ad9-a5b6-682f11e8680d tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1736 microversion: 2.1 time: 0.347294 Aug 24 16:48:20.492109 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 273/533] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:20 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1736 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:20.492109 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-85b740c1-3a6e-450d-baaf-618a6dadc8b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:20.492109 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-85b740c1-3a6e-450d-baaf-618a6dadc8b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:20.492109 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85b740c1-3a6e-450d-baaf-618a6dadc8b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.492642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85b740c1-3a6e-450d-baaf-618a6dadc8b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.492642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85b740c1-3a6e-450d-baaf-618a6dadc8b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.492642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85b740c1-3a6e-450d-baaf-618a6dadc8b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.492642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85b740c1-3a6e-450d-baaf-618a6dadc8b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.492974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85b740c1-3a6e-450d-baaf-618a6dadc8b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.493361 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:20.504814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:20.506313 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:20.507736 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b25b8772-9fa9-445b-b064-305235ceba0d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.356271 Aug 24 16:48:20.508559 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 261/534] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:20 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:20.513903 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-15a17a83-7a98-45b9-83d0-38768f894681 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:20.514547 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-15a17a83-7a98-45b9-83d0-38768f894681 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:20.523544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15a17a83-7a98-45b9-83d0-38768f894681 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.530479 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15a17a83-7a98-45b9-83d0-38768f894681 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.530479 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15a17a83-7a98-45b9-83d0-38768f894681 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.530479 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15a17a83-7a98-45b9-83d0-38768f894681 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.530479 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15a17a83-7a98-45b9-83d0-38768f894681 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.530858 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15a17a83-7a98-45b9-83d0-38768f894681 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.623100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-85b740c1-3a6e-450d-baaf-618a6dadc8b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:20.632591 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-85b740c1-3a6e-450d-baaf-618a6dadc8b0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1300 microversion: 2.1 time: 0.154195 Aug 24 16:48:20.633427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 274/535] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:20 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1300 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:20.774431 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-15a17a83-7a98-45b9-83d0-38768f894681 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:20.783556 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-15a17a83-7a98-45b9-83d0-38768f894681 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1678 microversion: 2.1 time: 0.274183 Aug 24 16:48:20.784131 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 262/536] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:20 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1678 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:21.499928 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c34a48a8-00dd-43bc-affc-a1279e435d94 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:21.500677 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c34a48a8-00dd-43bc-affc-a1279e435d94 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:21.507052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c34a48a8-00dd-43bc-affc-a1279e435d94 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.511634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c34a48a8-00dd-43bc-affc-a1279e435d94 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.511634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c34a48a8-00dd-43bc-affc-a1279e435d94 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.511634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c34a48a8-00dd-43bc-affc-a1279e435d94 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.511634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c34a48a8-00dd-43bc-affc-a1279e435d94 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.512320 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c34a48a8-00dd-43bc-affc-a1279e435d94 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.531729 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:21.532644 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:21.541491 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.542120 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.543406 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.544511 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.545864 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.546609 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.567699 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:21.834560 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c34a48a8-00dd-43bc-affc-a1279e435d94 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:21.841083 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:21.845052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c34a48a8-00dd-43bc-affc-a1279e435d94 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1716 microversion: 2.1 time: 0.349516 Aug 24 16:48:21.860825 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 275/537] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:21 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1716 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:21.860825 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e1e7256d-e0cd-4b54-9d34-28d01dbce755 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:21.860825 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e1e7256d-e0cd-4b54-9d34-28d01dbce755 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:21.860825 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1e7256d-e0cd-4b54-9d34-28d01dbce755 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.861774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1e7256d-e0cd-4b54-9d34-28d01dbce755 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.861774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1e7256d-e0cd-4b54-9d34-28d01dbce755 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.861774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1e7256d-e0cd-4b54-9d34-28d01dbce755 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.861774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1e7256d-e0cd-4b54-9d34-28d01dbce755 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.862322 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1e7256d-e0cd-4b54-9d34-28d01dbce755 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.870543 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:21.872474 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:21.874713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1779db22-732b-437f-9492-365aad2d3cf3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.347415 Aug 24 16:48:21.875675 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 263/538] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:21 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:21.881026 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-21d8b1cb-090f-427e-87fe-417264f89e05 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:21.882289 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-21d8b1cb-090f-427e-87fe-417264f89e05 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:21.900856 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21d8b1cb-090f-427e-87fe-417264f89e05 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.902652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21d8b1cb-090f-427e-87fe-417264f89e05 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.902652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21d8b1cb-090f-427e-87fe-417264f89e05 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.904749 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21d8b1cb-090f-427e-87fe-417264f89e05 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.905510 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21d8b1cb-090f-427e-87fe-417264f89e05 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.906367 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21d8b1cb-090f-427e-87fe-417264f89e05 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.125400 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e1e7256d-e0cd-4b54-9d34-28d01dbce755 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:22.134857 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e1e7256d-e0cd-4b54-9d34-28d01dbce755 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1368 microversion: 2.1 time: 0.288152 Aug 24 16:48:22.135444 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 276/539] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:21 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:22.155195 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:22.156166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:22.164013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.164836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.165505 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.166420 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.166900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.167425 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.198446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-21d8b1cb-090f-427e-87fe-417264f89e05 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:22.210596 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-21d8b1cb-090f-427e-87fe-417264f89e05 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1678 microversion: 2.1 time: 0.333471 Aug 24 16:48:22.211728 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 264/540] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:21 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1678 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:22.218532 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-19f18e57-14c6-4771-919e-0c46393139f9 req-ff6dbfba-9b5a-4e5e-9193-fbb9779e358e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75981127-7926-42dc-9ab3-1fe58eaf63e2", "tag": "ecde38d2-23a1-4f3d-83ab-8455ae18aa78"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:22.236061 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-19f18e57-14c6-4771-919e-0c46393139f9 req-ff6dbfba-9b5a-4e5e-9193-fbb9779e358e service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.236759 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-19f18e57-14c6-4771-919e-0c46393139f9 req-ff6dbfba-9b5a-4e5e-9193-fbb9779e358e service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.237307 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-19f18e57-14c6-4771-919e-0c46393139f9 req-ff6dbfba-9b5a-4e5e-9193-fbb9779e358e service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.252695 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-19f18e57-14c6-4771-919e-0c46393139f9 req-ff6dbfba-9b5a-4e5e-9193-fbb9779e358e service nova] Creating event network-changed:ecde38d2-23a1-4f3d-83ab-8455ae18aa78 for instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 on hv-cinder-73116 Aug 24 16:48:22.258612 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-19f18e57-14c6-4771-919e-0c46393139f9 req-ff6dbfba-9b5a-4e5e-9193-fbb9779e358e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045502 Aug 24 16:48:22.259434 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 265/541] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:22.286854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] HTTP exception thrown: Cannot 'detach_volume' instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 while it is in vm_state rescued Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Request method failure captured: Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments/0fffa87d-ce64-4d56-9b6f-1c8e8bb38821 HTTP/1.1 Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVrq4otjVfNs1uNhZq-g4sAERo3MCXWw2NQYHqborGd7Oaii9xLab3Pt0-8QlH74mIPv8kZJIE-LFWi6PcEjKsGX7UHEsOkoz3dyJSNGRmFq6On_8oypwQPm4-AgYkuvsGAxniLTuRpvFguDpbYuah9Oi7vrOEdpyuVVMqsr3ehiJM Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: c99d97707cc2485284d8d33522ebb918 Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:48:22.288621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:48:22.290021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c99d97707cc2485284d8d33522ebb918", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:48:22.290021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:48:22.290021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: c99d97707cc2485284d8d33522ebb918 Aug 24 16:48:22.290021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:48:22.290021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-ServerRescueNegativeTestJSON-1231782798-project Aug 24 16:48:22.290021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:48:22.290021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:48:22.290021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 7be50b041b5947d5909ed6ce516ec8bf Aug 24 16:48:22.290021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1231782798-project Aug 24 16:48:22.290021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:48:22.290021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Cannot 'detach_volume' instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 while it is in vm_state rescued Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'server_id': 'f4e8d907-5a6d-450e-92bc-a4ee16bde539', 'id': '0fffa87d-ce64-4d56-9b6f-1c8e8bb38821'} Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:48:22.290710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 while it is in vm_state rescued Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 while it is in vm_state rescued Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:48:22.291885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Returning 409 to user: Cannot 'detach_volume' instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 while it is in vm_state rescued {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:48:22.292922 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b1aa1bce-652c-4bf1-b9d3-595ddf213a9f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments/0fffa87d-ce64-4d56-9b6f-1c8e8bb38821" status: 409 len: 152 microversion: 2.1 time: 0.139576 Aug 24 16:48:22.292922 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 277/542] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:48:22 2022] DELETE /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments/0fffa87d-ce64-4d56-9b6f-1c8e8bb38821 => generated 152 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 16:48:22.299863 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e0f6d707-1bc3-42b9-ae95-b0365381c9d8 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:22.300505 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e0f6d707-1bc3-42b9-ae95-b0365381c9d8 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:22.307333 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e0f6d707-1bc3-42b9-ae95-b0365381c9d8 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.307837 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e0f6d707-1bc3-42b9-ae95-b0365381c9d8 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.308540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e0f6d707-1bc3-42b9-ae95-b0365381c9d8 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.309358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e0f6d707-1bc3-42b9-ae95-b0365381c9d8 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.310002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e0f6d707-1bc3-42b9-ae95-b0365381c9d8 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.310569 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e0f6d707-1bc3-42b9-ae95-b0365381c9d8 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.536865 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e0f6d707-1bc3-42b9-ae95-b0365381c9d8 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "POST /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/action" status: 202 len: 0 microversion: 2.1 time: 0.241238 Aug 24 16:48:22.537524 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 266/543] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:48:22 2022] POST /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:48:22.545723 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bed3e044-1086-4537-a160-1f7280595ce6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:22.546353 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bed3e044-1086-4537-a160-1f7280595ce6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:22.552857 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bed3e044-1086-4537-a160-1f7280595ce6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.553342 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bed3e044-1086-4537-a160-1f7280595ce6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.553774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bed3e044-1086-4537-a160-1f7280595ce6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.555086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bed3e044-1086-4537-a160-1f7280595ce6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.555552 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bed3e044-1086-4537-a160-1f7280595ce6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.555979 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bed3e044-1086-4537-a160-1f7280595ce6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.709498 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bed3e044-1086-4537-a160-1f7280595ce6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:22.717881 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bed3e044-1086-4537-a160-1f7280595ce6 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1724 microversion: 2.1 time: 0.176095 Aug 24 16:48:22.718415 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 278/544] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:22 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:22.901229 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:22.902073 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:22.908690 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.909176 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.909614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.910314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.910767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.911191 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.051626 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:23.061794 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:23.063871 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:23.065498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-21ba8ae5-6da0-4ba2-bbeb-21c383686081 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.169209 Aug 24 16:48:23.066137 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 267/545] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:22 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:23.156891 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fa7c38c1-e322-4ecd-a99a-6c9d791338b1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:23.157411 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fa7c38c1-e322-4ecd-a99a-6c9d791338b1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:23.167209 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa7c38c1-e322-4ecd-a99a-6c9d791338b1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.168214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa7c38c1-e322-4ecd-a99a-6c9d791338b1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.168693 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa7c38c1-e322-4ecd-a99a-6c9d791338b1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.169358 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa7c38c1-e322-4ecd-a99a-6c9d791338b1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.169802 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa7c38c1-e322-4ecd-a99a-6c9d791338b1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.170245 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa7c38c1-e322-4ecd-a99a-6c9d791338b1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.234764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ac6b8b04-e13b-4aa1-89ea-f323cedf6129 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:23.235815 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ac6b8b04-e13b-4aa1-89ea-f323cedf6129 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:23.241999 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac6b8b04-e13b-4aa1-89ea-f323cedf6129 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.242503 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac6b8b04-e13b-4aa1-89ea-f323cedf6129 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.242956 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac6b8b04-e13b-4aa1-89ea-f323cedf6129 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.243660 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac6b8b04-e13b-4aa1-89ea-f323cedf6129 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.244122 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac6b8b04-e13b-4aa1-89ea-f323cedf6129 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.244579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac6b8b04-e13b-4aa1-89ea-f323cedf6129 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.493735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa7c38c1-e322-4ecd-a99a-6c9d791338b1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:23.502328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fa7c38c1-e322-4ecd-a99a-6c9d791338b1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1368 microversion: 2.1 time: 0.349186 Aug 24 16:48:23.503704 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 279/546] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:23 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1368 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:23.605309 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ac6b8b04-e13b-4aa1-89ea-f323cedf6129 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:23.613057 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ac6b8b04-e13b-4aa1-89ea-f323cedf6129 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1678 microversion: 2.1 time: 0.383402 Aug 24 16:48:23.613627 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 268/547] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:23 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1678 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:23.739813 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4b798538-e24b-42b2-8c62-91089d216f6e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:23.740528 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4b798538-e24b-42b2-8c62-91089d216f6e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:23.747428 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4b798538-e24b-42b2-8c62-91089d216f6e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.747940 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4b798538-e24b-42b2-8c62-91089d216f6e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.748609 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4b798538-e24b-42b2-8c62-91089d216f6e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.749319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4b798538-e24b-42b2-8c62-91089d216f6e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.749774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4b798538-e24b-42b2-8c62-91089d216f6e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.750217 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4b798538-e24b-42b2-8c62-91089d216f6e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.893320 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4b798538-e24b-42b2-8c62-91089d216f6e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:23.903447 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4b798538-e24b-42b2-8c62-91089d216f6e tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1724 microversion: 2.1 time: 0.166338 Aug 24 16:48:23.904045 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 280/548] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:23 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:24.088968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:24.089632 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:24.096036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.096553 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.096989 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.097674 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.098124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.098542 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.234396 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:24.243103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:24.244642 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:24.246464 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-915b9fde-74e6-40b2-a215-c976915cf791 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.160759 Aug 24 16:48:24.247025 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 269/549] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:24 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:24.528283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-77bce2d0-409e-49b8-9ad8-4d2979943de4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:24.528937 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-77bce2d0-409e-49b8-9ad8-4d2979943de4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:24.535281 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77bce2d0-409e-49b8-9ad8-4d2979943de4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.535739 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77bce2d0-409e-49b8-9ad8-4d2979943de4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.536388 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77bce2d0-409e-49b8-9ad8-4d2979943de4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.536918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77bce2d0-409e-49b8-9ad8-4d2979943de4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.537374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77bce2d0-409e-49b8-9ad8-4d2979943de4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.537799 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77bce2d0-409e-49b8-9ad8-4d2979943de4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.635627 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0ec534bd-4665-4d74-942a-fa293e3c53ea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:24.636501 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0ec534bd-4665-4d74-942a-fa293e3c53ea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:24.644141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec534bd-4665-4d74-942a-fa293e3c53ea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.644691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec534bd-4665-4d74-942a-fa293e3c53ea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.645670 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec534bd-4665-4d74-942a-fa293e3c53ea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.646516 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec534bd-4665-4d74-942a-fa293e3c53ea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.646981 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec534bd-4665-4d74-942a-fa293e3c53ea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.647415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0ec534bd-4665-4d74-942a-fa293e3c53ea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.700626 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-77bce2d0-409e-49b8-9ad8-4d2979943de4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:24.711118 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-77bce2d0-409e-49b8-9ad8-4d2979943de4 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1368 microversion: 2.1 time: 0.187580 Aug 24 16:48:24.727337 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 281/550] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:24 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:24.924923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4016dfa5-8b3b-407a-a129-8983df637b30 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:24.925577 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4016dfa5-8b3b-407a-a129-8983df637b30 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:24.932613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4016dfa5-8b3b-407a-a129-8983df637b30 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.933116 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4016dfa5-8b3b-407a-a129-8983df637b30 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.934294 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4016dfa5-8b3b-407a-a129-8983df637b30 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.935206 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4016dfa5-8b3b-407a-a129-8983df637b30 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.935680 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4016dfa5-8b3b-407a-a129-8983df637b30 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.936116 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4016dfa5-8b3b-407a-a129-8983df637b30 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.326707 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0ec534bd-4665-4d74-942a-fa293e3c53ea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:25.339940 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0ec534bd-4665-4d74-942a-fa293e3c53ea tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1678 microversion: 2.1 time: 0.708405 Aug 24 16:48:25.354595 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 270/551] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:24 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1678 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:25.354595 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:25.354595 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:25.354595 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:25.355815 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:25.355815 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.356515 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:25.357536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:25.358129 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.546109 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4016dfa5-8b3b-407a-a129-8983df637b30 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:25.558937 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4016dfa5-8b3b-407a-a129-8983df637b30 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1724 microversion: 2.1 time: 0.637505 Aug 24 16:48:25.559960 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 282/552] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:24 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1724 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:25.672822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:25.683951 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:25.698448 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:25.700520 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-20db4d00-930b-48f1-9740-147be02e7617 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.357991 Aug 24 16:48:25.701133 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 271/553] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:25 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:25.734875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fbe7c19b-d581-4006-bbe3-fb648b9f82a0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:25.735481 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fbe7c19b-d581-4006-bbe3-fb648b9f82a0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:25.741448 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fbe7c19b-d581-4006-bbe3-fb648b9f82a0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:25.741936 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fbe7c19b-d581-4006-bbe3-fb648b9f82a0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:25.742367 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fbe7c19b-d581-4006-bbe3-fb648b9f82a0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.743060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fbe7c19b-d581-4006-bbe3-fb648b9f82a0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:25.743516 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fbe7c19b-d581-4006-bbe3-fb648b9f82a0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:25.743936 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fbe7c19b-d581-4006-bbe3-fb648b9f82a0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.989133 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fbe7c19b-d581-4006-bbe3-fb648b9f82a0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:25.997892 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fbe7c19b-d581-4006-bbe3-fb648b9f82a0 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1368 microversion: 2.1 time: 0.267485 Aug 24 16:48:25.998472 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 283/554] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:25 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:26.362911 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-88c337a0-e707-419d-992c-5d633e4b5923 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:26.363506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-88c337a0-e707-419d-992c-5d633e4b5923 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:26.370419 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-88c337a0-e707-419d-992c-5d633e4b5923 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.371004 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-88c337a0-e707-419d-992c-5d633e4b5923 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.371446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-88c337a0-e707-419d-992c-5d633e4b5923 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.372182 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-88c337a0-e707-419d-992c-5d633e4b5923 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.373085 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-88c337a0-e707-419d-992c-5d633e4b5923 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.373575 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-88c337a0-e707-419d-992c-5d633e4b5923 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.520900 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-88c337a0-e707-419d-992c-5d633e4b5923 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:26.529312 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-88c337a0-e707-419d-992c-5d633e4b5923 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1678 microversion: 2.1 time: 0.169617 Aug 24 16:48:26.530147 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 272/555] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:26 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:26.583751 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-db05e3f3-e3a5-4cdf-9dd6-8f4c80de09ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:26.584546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-db05e3f3-e3a5-4cdf-9dd6-8f4c80de09ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:26.592286 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db05e3f3-e3a5-4cdf-9dd6-8f4c80de09ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.592802 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db05e3f3-e3a5-4cdf-9dd6-8f4c80de09ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.593232 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db05e3f3-e3a5-4cdf-9dd6-8f4c80de09ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.593922 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db05e3f3-e3a5-4cdf-9dd6-8f4c80de09ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.594377 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db05e3f3-e3a5-4cdf-9dd6-8f4c80de09ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.594793 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-db05e3f3-e3a5-4cdf-9dd6-8f4c80de09ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.725321 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:26.726159 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:26.733108 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.733760 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.734288 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.735461 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.736010 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.736528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.758381 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-db05e3f3-e3a5-4cdf-9dd6-8f4c80de09ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:26.769372 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-db05e3f3-e3a5-4cdf-9dd6-8f4c80de09ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1724 microversion: 2.1 time: 0.189354 Aug 24 16:48:26.770287 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 284/556] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:26 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:26.885373 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:26.896285 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:26.903526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-9f1e91b9-56d5-45a8-a22b-73651b08694e req-3cd92383-eba6-407f-9a27-668591163729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eadb4fd-bee8-4fac-b072-550b720e3e95", "name": "network-vif-plugged", "status": "completed", "tag": "9793be94-7c34-443e-80f4-821b2863ba90"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:26.909479 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:26.910554 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a3272d20-4758-4d7f-958e-a7e78b964edb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.188978 Aug 24 16:48:26.910758 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 273/557] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:26 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:26.916565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-9f1e91b9-56d5-45a8-a22b-73651b08694e req-3cd92383-eba6-407f-9a27-668591163729 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.917352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-9f1e91b9-56d5-45a8-a22b-73651b08694e req-3cd92383-eba6-407f-9a27-668591163729 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.917822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-9f1e91b9-56d5-45a8-a22b-73651b08694e req-3cd92383-eba6-407f-9a27-668591163729 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.929859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-9f1e91b9-56d5-45a8-a22b-73651b08694e req-3cd92383-eba6-407f-9a27-668591163729 service nova] Creating event network-vif-plugged:9793be94-7c34-443e-80f4-821b2863ba90 for instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 on hv-cinder-73116 Aug 24 16:48:26.935390 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-9f1e91b9-56d5-45a8-a22b-73651b08694e req-3cd92383-eba6-407f-9a27-668591163729 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036176 Aug 24 16:48:26.936018 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 285/558] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:48:27.023905 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-430241a9-a25f-420e-96bc-8be69018a810 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:27.024558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-430241a9-a25f-420e-96bc-8be69018a810 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:27.031417 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430241a9-a25f-420e-96bc-8be69018a810 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.031905 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430241a9-a25f-420e-96bc-8be69018a810 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.032379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430241a9-a25f-420e-96bc-8be69018a810 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.033079 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430241a9-a25f-420e-96bc-8be69018a810 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.033579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430241a9-a25f-420e-96bc-8be69018a810 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.033996 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-430241a9-a25f-420e-96bc-8be69018a810 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.181053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-430241a9-a25f-420e-96bc-8be69018a810 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:27.190790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-430241a9-a25f-420e-96bc-8be69018a810 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1368 microversion: 2.1 time: 0.173716 Aug 24 16:48:27.191378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 274/559] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:27 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:27.552358 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d5acedb3-380b-4d79-b624-e7021202e76f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:27.553369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d5acedb3-380b-4d79-b624-e7021202e76f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:27.563209 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d5acedb3-380b-4d79-b624-e7021202e76f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.563730 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d5acedb3-380b-4d79-b624-e7021202e76f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.564189 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d5acedb3-380b-4d79-b624-e7021202e76f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.564960 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d5acedb3-380b-4d79-b624-e7021202e76f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.565407 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d5acedb3-380b-4d79-b624-e7021202e76f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.565822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d5acedb3-380b-4d79-b624-e7021202e76f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.706974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d5acedb3-380b-4d79-b624-e7021202e76f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:27.715283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d5acedb3-380b-4d79-b624-e7021202e76f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1678 microversion: 2.1 time: 0.166748 Aug 24 16:48:27.716110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 286/560] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:27 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:27.791094 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-09940e69-8d28-4401-b8f9-a528f3282f05 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:27.791742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-09940e69-8d28-4401-b8f9-a528f3282f05 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:27.801195 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09940e69-8d28-4401-b8f9-a528f3282f05 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.801685 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09940e69-8d28-4401-b8f9-a528f3282f05 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.802117 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09940e69-8d28-4401-b8f9-a528f3282f05 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.802901 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09940e69-8d28-4401-b8f9-a528f3282f05 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.803276 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09940e69-8d28-4401-b8f9-a528f3282f05 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.803758 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-09940e69-8d28-4401-b8f9-a528f3282f05 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.936110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:27.937058 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:27.944670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.944670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.945152 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.945833 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.946297 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.946785 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.959559 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-09940e69-8d28-4401-b8f9-a528f3282f05 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:27.967842 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:27.975056 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-09940e69-8d28-4401-b8f9-a528f3282f05 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1724 microversion: 2.1 time: 0.187370 Aug 24 16:48:27.976110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 275/561] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:27 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:28.093864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:28.103786 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:28.105340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:28.107043 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e5ff225f-402b-478c-8f9b-78d8fadb1f53 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.176075 Aug 24 16:48:28.107624 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 287/562] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:27 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:28.217058 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-922d6c74-7c59-4737-bdc0-ca9775683c03 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:28.217673 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-922d6c74-7c59-4737-bdc0-ca9775683c03 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:28.224317 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-922d6c74-7c59-4737-bdc0-ca9775683c03 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:28.224833 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-922d6c74-7c59-4737-bdc0-ca9775683c03 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:28.225272 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-922d6c74-7c59-4737-bdc0-ca9775683c03 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:28.225966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-922d6c74-7c59-4737-bdc0-ca9775683c03 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:28.226410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-922d6c74-7c59-4737-bdc0-ca9775683c03 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:28.226830 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-922d6c74-7c59-4737-bdc0-ca9775683c03 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:28.379705 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-922d6c74-7c59-4737-bdc0-ca9775683c03 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:28.389121 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-922d6c74-7c59-4737-bdc0-ca9775683c03 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1368 microversion: 2.1 time: 0.177771 Aug 24 16:48:28.389719 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 276/563] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:28 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:28.742392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9d78d412-862d-4e7d-a379-840717a138bb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:28.743301 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9d78d412-862d-4e7d-a379-840717a138bb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:28.750069 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d78d412-862d-4e7d-a379-840717a138bb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:28.750562 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d78d412-862d-4e7d-a379-840717a138bb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:28.750999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d78d412-862d-4e7d-a379-840717a138bb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:28.751712 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d78d412-862d-4e7d-a379-840717a138bb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:28.752170 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d78d412-862d-4e7d-a379-840717a138bb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:28.752639 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d78d412-862d-4e7d-a379-840717a138bb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:28.899811 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9d78d412-862d-4e7d-a379-840717a138bb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:28.910993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9d78d412-862d-4e7d-a379-840717a138bb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1678 microversion: 2.1 time: 0.172460 Aug 24 16:48:28.911805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 288/564] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:28 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:28.958837 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-7281ac81-acc2-4a59-a1b0-e6609e36a450 req-933d4d7f-c004-433a-9f13-ed96ac6f9fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75981127-7926-42dc-9ab3-1fe58eaf63e2", "name": "network-vif-plugged", "status": "completed", "tag": "ecde38d2-23a1-4f3d-83ab-8455ae18aa78"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:28.977206 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-7281ac81-acc2-4a59-a1b0-e6609e36a450 req-933d4d7f-c004-433a-9f13-ed96ac6f9fa7 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:28.977721 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-7281ac81-acc2-4a59-a1b0-e6609e36a450 req-933d4d7f-c004-433a-9f13-ed96ac6f9fa7 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:28.978161 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-7281ac81-acc2-4a59-a1b0-e6609e36a450 req-933d4d7f-c004-433a-9f13-ed96ac6f9fa7 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:28.992363 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-7281ac81-acc2-4a59-a1b0-e6609e36a450 req-933d4d7f-c004-433a-9f13-ed96ac6f9fa7 service nova] Creating event network-vif-plugged:ecde38d2-23a1-4f3d-83ab-8455ae18aa78 for instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 on hv-cinder-73116 Aug 24 16:48:28.998574 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-7281ac81-acc2-4a59-a1b0-e6609e36a450 req-933d4d7f-c004-433a-9f13-ed96ac6f9fa7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045559 Aug 24 16:48:28.999191 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 277/565] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:28.999381 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0f20eccb-a437-49bd-bcaf-06f802c2c21a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:28.999972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0f20eccb-a437-49bd-bcaf-06f802c2c21a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:29.006778 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f20eccb-a437-49bd-bcaf-06f802c2c21a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.007265 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f20eccb-a437-49bd-bcaf-06f802c2c21a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.007697 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f20eccb-a437-49bd-bcaf-06f802c2c21a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.008416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f20eccb-a437-49bd-bcaf-06f802c2c21a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.008910 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f20eccb-a437-49bd-bcaf-06f802c2c21a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.009480 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f20eccb-a437-49bd-bcaf-06f802c2c21a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.132209 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:29.132939 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:29.139307 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.139799 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.140242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.140983 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.141436 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.141914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.153070 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0f20eccb-a437-49bd-bcaf-06f802c2c21a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:29.162052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0f20eccb-a437-49bd-bcaf-06f802c2c21a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1730 microversion: 2.1 time: 0.168083 Aug 24 16:48:29.162756 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 289/566] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:28 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:29.183194 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1d56b224-6e64-4de3-bfba-641445ac2fd4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:29.184311 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1d56b224-6e64-4de3-bfba-641445ac2fd4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:29.190887 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d56b224-6e64-4de3-bfba-641445ac2fd4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.191372 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d56b224-6e64-4de3-bfba-641445ac2fd4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.191805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d56b224-6e64-4de3-bfba-641445ac2fd4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.192561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d56b224-6e64-4de3-bfba-641445ac2fd4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.193019 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d56b224-6e64-4de3-bfba-641445ac2fd4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.193444 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d56b224-6e64-4de3-bfba-641445ac2fd4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.306382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1d56b224-6e64-4de3-bfba-641445ac2fd4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126820 Aug 24 16:48:29.307287 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 290/567] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 16:48:29 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:48:29.337923 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:29.347711 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:29.349294 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:29.350477 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-40bdc6ba-7409-4ff8-8f1d-cc3d9a65e04e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.222763 Aug 24 16:48:29.351046 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 278/568] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:29 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:29.410300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e47e37ac-2569-4da8-9eb8-b777f838bbfc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:29.410904 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e47e37ac-2569-4da8-9eb8-b777f838bbfc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:29.417067 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e47e37ac-2569-4da8-9eb8-b777f838bbfc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.417533 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e47e37ac-2569-4da8-9eb8-b777f838bbfc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.417965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e47e37ac-2569-4da8-9eb8-b777f838bbfc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.419249 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e47e37ac-2569-4da8-9eb8-b777f838bbfc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.419701 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e47e37ac-2569-4da8-9eb8-b777f838bbfc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.420119 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e47e37ac-2569-4da8-9eb8-b777f838bbfc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.567376 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e47e37ac-2569-4da8-9eb8-b777f838bbfc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:29.576431 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e47e37ac-2569-4da8-9eb8-b777f838bbfc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1368 microversion: 2.1 time: 0.169803 Aug 24 16:48:29.577042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 291/569] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:29 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:29.933553 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2c3214aa-a211-43a8-82e3-4fc501de4474 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:29.934213 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2c3214aa-a211-43a8-82e3-4fc501de4474 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:29.940126 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c3214aa-a211-43a8-82e3-4fc501de4474 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.940653 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c3214aa-a211-43a8-82e3-4fc501de4474 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.941083 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c3214aa-a211-43a8-82e3-4fc501de4474 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.941869 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c3214aa-a211-43a8-82e3-4fc501de4474 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.942275 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c3214aa-a211-43a8-82e3-4fc501de4474 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.943112 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c3214aa-a211-43a8-82e3-4fc501de4474 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.081288 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2c3214aa-a211-43a8-82e3-4fc501de4474 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.089579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2c3214aa-a211-43a8-82e3-4fc501de4474 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1655 microversion: 2.1 time: 0.159871 Aug 24 16:48:30.091001 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 279/570] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:29 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:30.117818 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4854fb35-21e9-4c20-9017-8acbfb1dc72e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:30.124832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4854fb35-21e9-4c20-9017-8acbfb1dc72e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.125326 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4854fb35-21e9-4c20-9017-8acbfb1dc72e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.125761 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4854fb35-21e9-4c20-9017-8acbfb1dc72e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.148932 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4854fb35-21e9-4c20-9017-8acbfb1dc72e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Going to try to start instance {{(pid=127627) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 16:48:30.351059 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-e0187634-e934-4661-8f8a-130848e188a3 req-5044c087-06f1-4fd7-b0df-d430d5fce646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e8d907-5a6d-450e-92bc-a4ee16bde539", "tag": "d972466c-37b3-4485-ba2b-6a1659a3de80"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:30.364700 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-e0187634-e934-4661-8f8a-130848e188a3 req-5044c087-06f1-4fd7-b0df-d430d5fce646 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.365176 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-e0187634-e934-4661-8f8a-130848e188a3 req-5044c087-06f1-4fd7-b0df-d430d5fce646 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.365708 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-e0187634-e934-4661-8f8a-130848e188a3 req-5044c087-06f1-4fd7-b0df-d430d5fce646 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.370213 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:30.378129 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-e0187634-e934-4661-8f8a-130848e188a3 req-5044c087-06f1-4fd7-b0df-d430d5fce646 service nova] Creating event network-changed:d972466c-37b3-4485-ba2b-6a1659a3de80 for instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 on hv-cinder-73116 Aug 24 16:48:30.383360 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-e0187634-e934-4661-8f8a-130848e188a3 req-5044c087-06f1-4fd7-b0df-d430d5fce646 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042120 Aug 24 16:48:30.384255 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 280/571] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:30.387393 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4854fb35-21e9-4c20-9017-8acbfb1dc72e tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "POST /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/action" status: 202 len: 0 microversion: 2.1 time: 0.272765 Aug 24 16:48:30.388128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 292/572] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:48:30 2022] POST /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:48:30.394774 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:30.394774 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:30.397724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bc5f1111-be1e-4919-922b-5c37262cdba6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:30.398441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bc5f1111-be1e-4919-922b-5c37262cdba6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:30.398595 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.399271 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.399706 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.400432 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.400887 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.401307 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.406322 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc5f1111-be1e-4919-922b-5c37262cdba6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.406838 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc5f1111-be1e-4919-922b-5c37262cdba6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.407306 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc5f1111-be1e-4919-922b-5c37262cdba6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.408236 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc5f1111-be1e-4919-922b-5c37262cdba6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.408789 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc5f1111-be1e-4919-922b-5c37262cdba6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.409240 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc5f1111-be1e-4919-922b-5c37262cdba6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.714913 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.726861 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.728445 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.729733 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0da15c6a-33e1-42ef-bbcf-0e44c23e514e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.343409 Aug 24 16:48:30.730587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 281/573] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:30 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:30.739280 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bc5f1111-be1e-4919-922b-5c37262cdba6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.752390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-265dc4a0-2b32-40fb-9219-686830279e1e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:30.756180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-265dc4a0-2b32-40fb-9219-686830279e1e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:30.758566 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bc5f1111-be1e-4919-922b-5c37262cdba6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1664 microversion: 2.1 time: 0.365107 Aug 24 16:48:30.759189 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 293/574] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:30 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1664 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:30.764001 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-265dc4a0-2b32-40fb-9219-686830279e1e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.764531 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-265dc4a0-2b32-40fb-9219-686830279e1e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.764971 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-265dc4a0-2b32-40fb-9219-686830279e1e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.766332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-265dc4a0-2b32-40fb-9219-686830279e1e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.766798 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-265dc4a0-2b32-40fb-9219-686830279e1e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.767230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-265dc4a0-2b32-40fb-9219-686830279e1e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.914980 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-265dc4a0-2b32-40fb-9219-686830279e1e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.928024 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-265dc4a0-2b32-40fb-9219-686830279e1e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1368 microversion: 2.1 time: 0.189981 Aug 24 16:48:30.928024 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 282/575] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:30 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:31.755409 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:31.756692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:31.764969 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.765610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.766127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.766827 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.767275 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.772585 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.782296 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f3fed6a3-008e-4ca4-892f-e85aede5a276 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:31.783011 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f3fed6a3-008e-4ca4-892f-e85aede5a276 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:31.789837 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3fed6a3-008e-4ca4-892f-e85aede5a276 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.792633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3fed6a3-008e-4ca4-892f-e85aede5a276 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.792633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3fed6a3-008e-4ca4-892f-e85aede5a276 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.792633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3fed6a3-008e-4ca4-892f-e85aede5a276 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.792633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3fed6a3-008e-4ca4-892f-e85aede5a276 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.792996 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f3fed6a3-008e-4ca4-892f-e85aede5a276 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.994826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:32.006486 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:32.008442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:32.010416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8fd6b2de-53a0-46f3-9277-846d84780916 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1808 microversion: 2.20 time: 0.258831 Aug 24 16:48:32.011060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 294/576] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:31 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:32.017337 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9bf9b399-b545-466d-bdf0-19b4412e21f7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:32.017999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9bf9b399-b545-466d-bdf0-19b4412e21f7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:32.024796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bf9b399-b545-466d-bdf0-19b4412e21f7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:32.026086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bf9b399-b545-466d-bdf0-19b4412e21f7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:32.026733 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bf9b399-b545-466d-bdf0-19b4412e21f7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:32.027614 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bf9b399-b545-466d-bdf0-19b4412e21f7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:32.029029 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bf9b399-b545-466d-bdf0-19b4412e21f7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:32.029464 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bf9b399-b545-466d-bdf0-19b4412e21f7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:32.041414 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f3fed6a3-008e-4ca4-892f-e85aede5a276 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:32.053610 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f3fed6a3-008e-4ca4-892f-e85aede5a276 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1664 microversion: 2.1 time: 0.276736 Aug 24 16:48:32.055186 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 283/577] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:31 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1664 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:32.065119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ff1968dc-47a2-4b9f-b09f-4af6c587af23 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:32.067439 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ff1968dc-47a2-4b9f-b09f-4af6c587af23 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:32.077549 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff1968dc-47a2-4b9f-b09f-4af6c587af23 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:32.078042 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff1968dc-47a2-4b9f-b09f-4af6c587af23 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:32.078750 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff1968dc-47a2-4b9f-b09f-4af6c587af23 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:32.079457 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff1968dc-47a2-4b9f-b09f-4af6c587af23 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:32.079914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff1968dc-47a2-4b9f-b09f-4af6c587af23 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:32.080361 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff1968dc-47a2-4b9f-b09f-4af6c587af23 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:32.229736 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9bf9b399-b545-466d-bdf0-19b4412e21f7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:32.238158 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9bf9b399-b545-466d-bdf0-19b4412e21f7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1368 microversion: 2.1 time: 0.224929 Aug 24 16:48:32.238755 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 295/578] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:32 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:32.378860 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ff1968dc-47a2-4b9f-b09f-4af6c587af23 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "POST /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/action" status: 202 len: 0 microversion: 2.1 time: 0.321824 Aug 24 16:48:32.385267 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 284/579] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:48:32 2022] POST /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:48:32.387986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-47ef2a3f-5045-49fe-8838-55daf0916c62 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:32.389226 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-47ef2a3f-5045-49fe-8838-55daf0916c62 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:32.396654 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47ef2a3f-5045-49fe-8838-55daf0916c62 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:32.397358 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47ef2a3f-5045-49fe-8838-55daf0916c62 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:32.397950 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47ef2a3f-5045-49fe-8838-55daf0916c62 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:32.398818 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47ef2a3f-5045-49fe-8838-55daf0916c62 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:32.399435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47ef2a3f-5045-49fe-8838-55daf0916c62 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:32.399862 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47ef2a3f-5045-49fe-8838-55daf0916c62 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:32.401920 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-af79164d-e29e-4b24-a516-ff57741a1aa6 req-f31bcb93-980a-4b14-91c9-d291cc4cf108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e8d907-5a6d-450e-92bc-a4ee16bde539", "tag": "d972466c-37b3-4485-ba2b-6a1659a3de80"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:32.413209 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-af79164d-e29e-4b24-a516-ff57741a1aa6 req-f31bcb93-980a-4b14-91c9-d291cc4cf108 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:32.416186 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-af79164d-e29e-4b24-a516-ff57741a1aa6 req-f31bcb93-980a-4b14-91c9-d291cc4cf108 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:32.416186 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-af79164d-e29e-4b24-a516-ff57741a1aa6 req-f31bcb93-980a-4b14-91c9-d291cc4cf108 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:32.425843 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-af79164d-e29e-4b24-a516-ff57741a1aa6 req-f31bcb93-980a-4b14-91c9-d291cc4cf108 service nova] Creating event network-changed:d972466c-37b3-4485-ba2b-6a1659a3de80 for instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 on hv-cinder-73116 Aug 24 16:48:32.430933 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-af79164d-e29e-4b24-a516-ff57741a1aa6 req-f31bcb93-980a-4b14-91c9-d291cc4cf108 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032952 Aug 24 16:48:32.431689 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 285/580] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:48:32.593443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-47ef2a3f-5045-49fe-8838-55daf0916c62 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:32.603444 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-47ef2a3f-5045-49fe-8838-55daf0916c62 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1752 microversion: 2.1 time: 0.219472 Aug 24 16:48:32.604272 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 296/581] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:32 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1752 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:33.038068 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:33.038760 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:33.045732 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.046220 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.046659 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.047363 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.047817 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.048243 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.076293 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8132f506-7809-4da8-b870-5739bbb17847 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:33.076994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8132f506-7809-4da8-b870-5739bbb17847 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:33.079398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:33.084247 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8132f506-7809-4da8-b870-5739bbb17847 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.084763 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8132f506-7809-4da8-b870-5739bbb17847 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.085226 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8132f506-7809-4da8-b870-5739bbb17847 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.085919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8132f506-7809-4da8-b870-5739bbb17847 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.086368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8132f506-7809-4da8-b870-5739bbb17847 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.086784 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8132f506-7809-4da8-b870-5739bbb17847 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.238577 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:33.251723 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:33.254540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:33.255349 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9a5cafb6-be90-41c7-bdcc-e4370501ade4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1795 microversion: 2.20 time: 0.222374 Aug 24 16:48:33.256314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 286/582] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:33 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1795 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:33.261038 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-723c925f-3fb1-4c31-8b68-92f7e7591641 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:33.261657 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-723c925f-3fb1-4c31-8b68-92f7e7591641 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:33.266747 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8132f506-7809-4da8-b870-5739bbb17847 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:33.274942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-723c925f-3fb1-4c31-8b68-92f7e7591641 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.275430 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-723c925f-3fb1-4c31-8b68-92f7e7591641 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.276049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-723c925f-3fb1-4c31-8b68-92f7e7591641 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.276658 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8132f506-7809-4da8-b870-5739bbb17847 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1664 microversion: 2.1 time: 0.203957 Aug 24 16:48:33.276783 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-723c925f-3fb1-4c31-8b68-92f7e7591641 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.277243 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-723c925f-3fb1-4c31-8b68-92f7e7591641 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.277375 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 297/583] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:33 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1664 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:33.277667 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-723c925f-3fb1-4c31-8b68-92f7e7591641 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.500478 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-723c925f-3fb1-4c31-8b68-92f7e7591641 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:33.508714 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-723c925f-3fb1-4c31-8b68-92f7e7591641 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1559 microversion: 2.1 time: 0.251267 Aug 24 16:48:33.515423 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 287/584] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:33 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1559 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:33.533609 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dea15639-61f6-4b1a-9f96-e2234767f120 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:33.534410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-dea15639-61f6-4b1a-9f96-e2234767f120 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:33.540811 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dea15639-61f6-4b1a-9f96-e2234767f120 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.541540 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dea15639-61f6-4b1a-9f96-e2234767f120 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.542154 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dea15639-61f6-4b1a-9f96-e2234767f120 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.544817 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dea15639-61f6-4b1a-9f96-e2234767f120 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.548962 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dea15639-61f6-4b1a-9f96-e2234767f120 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.548962 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dea15639-61f6-4b1a-9f96-e2234767f120 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.627264 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-69b2f27a-a19a-4dd0-8dcc-f89536f814dd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:33.628058 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-69b2f27a-a19a-4dd0-8dcc-f89536f814dd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:33.634490 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69b2f27a-a19a-4dd0-8dcc-f89536f814dd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.635214 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69b2f27a-a19a-4dd0-8dcc-f89536f814dd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.635790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69b2f27a-a19a-4dd0-8dcc-f89536f814dd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.636734 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69b2f27a-a19a-4dd0-8dcc-f89536f814dd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.638098 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69b2f27a-a19a-4dd0-8dcc-f89536f814dd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.638264 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69b2f27a-a19a-4dd0-8dcc-f89536f814dd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.649903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-dea15639-61f6-4b1a-9f96-e2234767f120 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122007 Aug 24 16:48:33.650513 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 298/585] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 16:48:33 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:34.092261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-69b2f27a-a19a-4dd0-8dcc-f89536f814dd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:34.101127 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-69b2f27a-a19a-4dd0-8dcc-f89536f814dd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1752 microversion: 2.1 time: 0.478611 Aug 24 16:48:34.102044 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 288/586] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:33 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1752 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:34.300324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-40356510-985e-483f-85e1-2ef8dc19c66b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:34.301141 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-40356510-985e-483f-85e1-2ef8dc19c66b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:34.312635 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-40356510-985e-483f-85e1-2ef8dc19c66b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:34.313441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-40356510-985e-483f-85e1-2ef8dc19c66b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:34.314153 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-40356510-985e-483f-85e1-2ef8dc19c66b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:34.315282 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-40356510-985e-483f-85e1-2ef8dc19c66b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:34.316029 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-40356510-985e-483f-85e1-2ef8dc19c66b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:34.316694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-40356510-985e-483f-85e1-2ef8dc19c66b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:34.661489 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-40356510-985e-483f-85e1-2ef8dc19c66b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:34.669718 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-40356510-985e-483f-85e1-2ef8dc19c66b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1668 microversion: 2.1 time: 0.374152 Aug 24 16:48:34.671231 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 299/587] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:34 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1668 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:35.124588 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6333c420-cc1f-4e2c-9d8f-8c41f9002e7a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:35.125476 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6333c420-cc1f-4e2c-9d8f-8c41f9002e7a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:35.136254 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6333c420-cc1f-4e2c-9d8f-8c41f9002e7a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.137029 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6333c420-cc1f-4e2c-9d8f-8c41f9002e7a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.137758 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6333c420-cc1f-4e2c-9d8f-8c41f9002e7a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.138748 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6333c420-cc1f-4e2c-9d8f-8c41f9002e7a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.139240 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6333c420-cc1f-4e2c-9d8f-8c41f9002e7a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.139677 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6333c420-cc1f-4e2c-9d8f-8c41f9002e7a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.305234 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-20e8ee49-9493-47ae-8e43-c13f141e700b req-e191882a-8878-432f-adfa-320fe4cdd6bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75981127-7926-42dc-9ab3-1fe58eaf63e2", "tag": "ecde38d2-23a1-4f3d-83ab-8455ae18aa78"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:35.315718 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-20e8ee49-9493-47ae-8e43-c13f141e700b req-e191882a-8878-432f-adfa-320fe4cdd6bb service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.316204 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-20e8ee49-9493-47ae-8e43-c13f141e700b req-e191882a-8878-432f-adfa-320fe4cdd6bb service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.317032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-20e8ee49-9493-47ae-8e43-c13f141e700b req-e191882a-8878-432f-adfa-320fe4cdd6bb service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.329887 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-20e8ee49-9493-47ae-8e43-c13f141e700b req-e191882a-8878-432f-adfa-320fe4cdd6bb service nova] Creating event network-changed:ecde38d2-23a1-4f3d-83ab-8455ae18aa78 for instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 on hv-cinder-73116 Aug 24 16:48:35.335249 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-20e8ee49-9493-47ae-8e43-c13f141e700b req-e191882a-8878-432f-adfa-320fe4cdd6bb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034169 Aug 24 16:48:35.335829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 300/588] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:48:35.385758 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-6333c420-cc1f-4e2c-9d8f-8c41f9002e7a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:35.394692 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6333c420-cc1f-4e2c-9d8f-8c41f9002e7a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.275349 Aug 24 16:48:35.395268 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 289/589] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:35 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:36.422247 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6d7e7c58-ef06-4e2d-9a48-ccdb040ed7f1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:36.422853 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6d7e7c58-ef06-4e2d-9a48-ccdb040ed7f1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:36.429302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d7e7c58-ef06-4e2d-9a48-ccdb040ed7f1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:36.429791 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d7e7c58-ef06-4e2d-9a48-ccdb040ed7f1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:36.430225 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d7e7c58-ef06-4e2d-9a48-ccdb040ed7f1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:36.430926 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d7e7c58-ef06-4e2d-9a48-ccdb040ed7f1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:36.431385 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d7e7c58-ef06-4e2d-9a48-ccdb040ed7f1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:36.431811 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d7e7c58-ef06-4e2d-9a48-ccdb040ed7f1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:36.584586 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6d7e7c58-ef06-4e2d-9a48-ccdb040ed7f1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:36.594079 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6d7e7c58-ef06-4e2d-9a48-ccdb040ed7f1 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.176687 Aug 24 16:48:36.594647 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 301/590] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:36 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:37.616680 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-91287ad9-f17d-48e9-9bdc-1be7623d6c4b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:37.617426 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-91287ad9-f17d-48e9-9bdc-1be7623d6c4b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:37.624236 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91287ad9-f17d-48e9-9bdc-1be7623d6c4b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:37.624743 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91287ad9-f17d-48e9-9bdc-1be7623d6c4b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:37.625174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91287ad9-f17d-48e9-9bdc-1be7623d6c4b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:37.625862 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91287ad9-f17d-48e9-9bdc-1be7623d6c4b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:37.626309 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91287ad9-f17d-48e9-9bdc-1be7623d6c4b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:37.626728 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91287ad9-f17d-48e9-9bdc-1be7623d6c4b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:37.787652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-91287ad9-f17d-48e9-9bdc-1be7623d6c4b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:37.797680 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-91287ad9-f17d-48e9-9bdc-1be7623d6c4b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.184830 Aug 24 16:48:37.798261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 290/591] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:37 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:38.819973 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-77909d11-be5c-4a95-9799-5d02226ac594 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:38.820597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-77909d11-be5c-4a95-9799-5d02226ac594 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:38.827839 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77909d11-be5c-4a95-9799-5d02226ac594 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:38.828440 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77909d11-be5c-4a95-9799-5d02226ac594 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:38.828895 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77909d11-be5c-4a95-9799-5d02226ac594 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:38.829612 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77909d11-be5c-4a95-9799-5d02226ac594 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:38.830061 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77909d11-be5c-4a95-9799-5d02226ac594 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:38.830502 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-77909d11-be5c-4a95-9799-5d02226ac594 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:38.983567 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-77909d11-be5c-4a95-9799-5d02226ac594 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:38.992281 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-77909d11-be5c-4a95-9799-5d02226ac594 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.176330 Aug 24 16:48:38.992896 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 302/592] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:38 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:40.014370 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a639cb89-5702-423e-a771-430f50c4d005 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:40.015050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a639cb89-5702-423e-a771-430f50c4d005 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:40.021481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a639cb89-5702-423e-a771-430f50c4d005 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.021966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a639cb89-5702-423e-a771-430f50c4d005 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.022705 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a639cb89-5702-423e-a771-430f50c4d005 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.023404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a639cb89-5702-423e-a771-430f50c4d005 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.023865 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a639cb89-5702-423e-a771-430f50c4d005 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.024288 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a639cb89-5702-423e-a771-430f50c4d005 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.180735 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a639cb89-5702-423e-a771-430f50c4d005 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:40.189462 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a639cb89-5702-423e-a771-430f50c4d005 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.180094 Aug 24 16:48:40.190026 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 291/593] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:40 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:41.210568 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3afb467f-cd06-468a-8a0e-c21d766b698c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:41.211096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3afb467f-cd06-468a-8a0e-c21d766b698c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:41.218982 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3afb467f-cd06-468a-8a0e-c21d766b698c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:41.219478 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3afb467f-cd06-468a-8a0e-c21d766b698c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:41.219918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3afb467f-cd06-468a-8a0e-c21d766b698c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:41.220663 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3afb467f-cd06-468a-8a0e-c21d766b698c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:41.221112 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3afb467f-cd06-468a-8a0e-c21d766b698c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:41.221539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3afb467f-cd06-468a-8a0e-c21d766b698c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:41.368823 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3afb467f-cd06-468a-8a0e-c21d766b698c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:41.378455 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3afb467f-cd06-468a-8a0e-c21d766b698c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.171670 Aug 24 16:48:41.379038 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 303/594] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:41 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:42.401984 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5239b4e2-b70f-4951-b7c1-c33fc0a26215 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:42.402574 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-5239b4e2-b70f-4951-b7c1-c33fc0a26215 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:42.409806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5239b4e2-b70f-4951-b7c1-c33fc0a26215 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.410293 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5239b4e2-b70f-4951-b7c1-c33fc0a26215 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.410726 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5239b4e2-b70f-4951-b7c1-c33fc0a26215 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.411429 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5239b4e2-b70f-4951-b7c1-c33fc0a26215 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.411879 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5239b4e2-b70f-4951-b7c1-c33fc0a26215 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.412299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5239b4e2-b70f-4951-b7c1-c33fc0a26215 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.576075 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5239b4e2-b70f-4951-b7c1-c33fc0a26215 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:42.585342 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5239b4e2-b70f-4951-b7c1-c33fc0a26215 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.187357 Aug 24 16:48:42.585947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 292/595] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:42 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:43.606234 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c547e370-a7d5-4f67-afc8-27a276a87c1a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:43.612155 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c547e370-a7d5-4f67-afc8-27a276a87c1a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:43.615141 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c547e370-a7d5-4f67-afc8-27a276a87c1a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:43.615634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c547e370-a7d5-4f67-afc8-27a276a87c1a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:43.616069 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c547e370-a7d5-4f67-afc8-27a276a87c1a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:43.616808 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c547e370-a7d5-4f67-afc8-27a276a87c1a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:43.617258 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c547e370-a7d5-4f67-afc8-27a276a87c1a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:43.617676 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c547e370-a7d5-4f67-afc8-27a276a87c1a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:43.637691 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:43.775242 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c547e370-a7d5-4f67-afc8-27a276a87c1a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:43.785518 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c547e370-a7d5-4f67-afc8-27a276a87c1a tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.182892 Aug 24 16:48:43.786521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 304/596] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:43 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:44.812479 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9fb534f0-0186-4dbe-9d98-b9f96f3c1ee0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:44.813112 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9fb534f0-0186-4dbe-9d98-b9f96f3c1ee0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:44.820260 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fb534f0-0186-4dbe-9d98-b9f96f3c1ee0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:44.820818 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fb534f0-0186-4dbe-9d98-b9f96f3c1ee0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:44.821315 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fb534f0-0186-4dbe-9d98-b9f96f3c1ee0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:44.822025 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fb534f0-0186-4dbe-9d98-b9f96f3c1ee0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:44.822477 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fb534f0-0186-4dbe-9d98-b9f96f3c1ee0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:44.822898 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9fb534f0-0186-4dbe-9d98-b9f96f3c1ee0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:44.973958 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9fb534f0-0186-4dbe-9d98-b9f96f3c1ee0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:44.982702 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9fb534f0-0186-4dbe-9d98-b9f96f3c1ee0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.175461 Aug 24 16:48:44.983522 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 293/597] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:44 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:46.005062 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3153575e-cdee-47df-a408-f86fedc6d627 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:46.005680 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3153575e-cdee-47df-a408-f86fedc6d627 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:46.012320 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3153575e-cdee-47df-a408-f86fedc6d627 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.012845 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3153575e-cdee-47df-a408-f86fedc6d627 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.013882 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3153575e-cdee-47df-a408-f86fedc6d627 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.014821 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3153575e-cdee-47df-a408-f86fedc6d627 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.015283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3153575e-cdee-47df-a408-f86fedc6d627 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.015709 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3153575e-cdee-47df-a408-f86fedc6d627 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.176797 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3153575e-cdee-47df-a408-f86fedc6d627 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:46.186025 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3153575e-cdee-47df-a408-f86fedc6d627 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.184189 Aug 24 16:48:46.186616 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 305/598] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:45 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:47.207701 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8fa2c67d-8531-4459-b282-c007e9a469d0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:47.208401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8fa2c67d-8531-4459-b282-c007e9a469d0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:47.215451 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fa2c67d-8531-4459-b282-c007e9a469d0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.216026 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fa2c67d-8531-4459-b282-c007e9a469d0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.216442 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fa2c67d-8531-4459-b282-c007e9a469d0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.217756 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fa2c67d-8531-4459-b282-c007e9a469d0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.218311 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fa2c67d-8531-4459-b282-c007e9a469d0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.218745 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8fa2c67d-8531-4459-b282-c007e9a469d0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.376128 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8fa2c67d-8531-4459-b282-c007e9a469d0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:47.385038 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8fa2c67d-8531-4459-b282-c007e9a469d0 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.181058 Aug 24 16:48:47.385840 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 294/599] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:47 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:48.407634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f1696fd7-546a-4dfe-99d3-961b6a3f2c74 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:48.408245 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f1696fd7-546a-4dfe-99d3-961b6a3f2c74 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:48.415017 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1696fd7-546a-4dfe-99d3-961b6a3f2c74 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:48.415510 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1696fd7-546a-4dfe-99d3-961b6a3f2c74 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:48.415947 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1696fd7-546a-4dfe-99d3-961b6a3f2c74 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:48.416688 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1696fd7-546a-4dfe-99d3-961b6a3f2c74 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:48.417144 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1696fd7-546a-4dfe-99d3-961b6a3f2c74 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:48.417593 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1696fd7-546a-4dfe-99d3-961b6a3f2c74 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:48.579332 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f1696fd7-546a-4dfe-99d3-961b6a3f2c74 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:48.586500 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f1696fd7-546a-4dfe-99d3-961b6a3f2c74 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.183148 Aug 24 16:48:48.587323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 306/600] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:48 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:49.608964 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-25c5ccaa-812e-4544-add3-585723209a5e tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:49.609572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-25c5ccaa-812e-4544-add3-585723209a5e tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:49.612041 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=72 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:49.616954 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c5ccaa-812e-4544-add3-585723209a5e tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:49.617429 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c5ccaa-812e-4544-add3-585723209a5e tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:49.617856 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c5ccaa-812e-4544-add3-585723209a5e tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:49.618534 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c5ccaa-812e-4544-add3-585723209a5e tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:49.618987 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c5ccaa-812e-4544-add3-585723209a5e tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:49.619442 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c5ccaa-812e-4544-add3-585723209a5e tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:49.770517 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-25c5ccaa-812e-4544-add3-585723209a5e tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:49.779049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-25c5ccaa-812e-4544-add3-585723209a5e tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.174003 Aug 24 16:48:49.779678 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 295/601] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:49 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:50.801967 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-27ee121d-af1f-461b-be4e-28517d3fd161 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:50.802596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-27ee121d-af1f-461b-be4e-28517d3fd161 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:50.809165 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ee121d-af1f-461b-be4e-28517d3fd161 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:50.809645 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ee121d-af1f-461b-be4e-28517d3fd161 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:50.810071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ee121d-af1f-461b-be4e-28517d3fd161 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:50.811487 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ee121d-af1f-461b-be4e-28517d3fd161 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:50.811940 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ee121d-af1f-461b-be4e-28517d3fd161 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:50.812374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27ee121d-af1f-461b-be4e-28517d3fd161 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:50.971691 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-27ee121d-af1f-461b-be4e-28517d3fd161 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:50.980184 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-27ee121d-af1f-461b-be4e-28517d3fd161 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.182232 Aug 24 16:48:50.980799 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 307/602] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:50 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:52.003356 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d7f3fc13-a2ac-49c5-b4b5-1fbb162b38eb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:52.003959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d7f3fc13-a2ac-49c5-b4b5-1fbb162b38eb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:52.010541 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d7f3fc13-a2ac-49c5-b4b5-1fbb162b38eb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:52.011015 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d7f3fc13-a2ac-49c5-b4b5-1fbb162b38eb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:52.011444 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d7f3fc13-a2ac-49c5-b4b5-1fbb162b38eb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:52.012205 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d7f3fc13-a2ac-49c5-b4b5-1fbb162b38eb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:52.012870 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d7f3fc13-a2ac-49c5-b4b5-1fbb162b38eb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:52.013291 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d7f3fc13-a2ac-49c5-b4b5-1fbb162b38eb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:52.164368 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d7f3fc13-a2ac-49c5-b4b5-1fbb162b38eb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:52.174269 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d7f3fc13-a2ac-49c5-b4b5-1fbb162b38eb tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.175144 Aug 24 16:48:52.174850 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 296/603] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:51 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:53.195667 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-507251fe-24cb-48ad-9580-9eed4fcf6fd4 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:53.196223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-507251fe-24cb-48ad-9580-9eed4fcf6fd4 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:53.203592 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507251fe-24cb-48ad-9580-9eed4fcf6fd4 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:53.204075 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507251fe-24cb-48ad-9580-9eed4fcf6fd4 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:53.204546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507251fe-24cb-48ad-9580-9eed4fcf6fd4 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:53.205251 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507251fe-24cb-48ad-9580-9eed4fcf6fd4 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:53.205706 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507251fe-24cb-48ad-9580-9eed4fcf6fd4 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:53.206131 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507251fe-24cb-48ad-9580-9eed4fcf6fd4 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:53.362142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-507251fe-24cb-48ad-9580-9eed4fcf6fd4 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:53.370674 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-507251fe-24cb-48ad-9580-9eed4fcf6fd4 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.178950 Aug 24 16:48:53.371254 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 308/604] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:53 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:54.394202 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d666b8e8-e8ab-4cc0-aba2-c424ef2ef43f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:54.394837 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d666b8e8-e8ab-4cc0-aba2-c424ef2ef43f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:54.401923 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d666b8e8-e8ab-4cc0-aba2-c424ef2ef43f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:54.402404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d666b8e8-e8ab-4cc0-aba2-c424ef2ef43f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:54.402836 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d666b8e8-e8ab-4cc0-aba2-c424ef2ef43f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:54.403531 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d666b8e8-e8ab-4cc0-aba2-c424ef2ef43f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:54.404008 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d666b8e8-e8ab-4cc0-aba2-c424ef2ef43f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:54.404453 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d666b8e8-e8ab-4cc0-aba2-c424ef2ef43f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:54.409763 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:54.558317 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d666b8e8-e8ab-4cc0-aba2-c424ef2ef43f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:54.566806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d666b8e8-e8ab-4cc0-aba2-c424ef2ef43f tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.176538 Aug 24 16:48:54.567378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 297/605] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:54 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:55.589545 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b0ad3613-53ac-462b-98fc-223397006cdd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:55.590957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b0ad3613-53ac-462b-98fc-223397006cdd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:55.599658 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0ad3613-53ac-462b-98fc-223397006cdd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:55.600267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0ad3613-53ac-462b-98fc-223397006cdd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:55.601038 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0ad3613-53ac-462b-98fc-223397006cdd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:55.602321 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0ad3613-53ac-462b-98fc-223397006cdd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:55.603097 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0ad3613-53ac-462b-98fc-223397006cdd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:55.603999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0ad3613-53ac-462b-98fc-223397006cdd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:55.772738 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b0ad3613-53ac-462b-98fc-223397006cdd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:55.785925 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b0ad3613-53ac-462b-98fc-223397006cdd tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1757 microversion: 2.1 time: 0.200189 Aug 24 16:48:55.786572 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 309/606] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:55 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:56.809898 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0dd65aae-eb5e-4402-9d3d-792b0db92c45 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:56.810531 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0dd65aae-eb5e-4402-9d3d-792b0db92c45 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:56.817821 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0dd65aae-eb5e-4402-9d3d-792b0db92c45 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:56.818301 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0dd65aae-eb5e-4402-9d3d-792b0db92c45 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:56.818730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0dd65aae-eb5e-4402-9d3d-792b0db92c45 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:56.819450 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0dd65aae-eb5e-4402-9d3d-792b0db92c45 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:56.819936 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0dd65aae-eb5e-4402-9d3d-792b0db92c45 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:56.820383 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0dd65aae-eb5e-4402-9d3d-792b0db92c45 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:56.996718 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0dd65aae-eb5e-4402-9d3d-792b0db92c45 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:57.006258 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0dd65aae-eb5e-4402-9d3d-792b0db92c45 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1760 microversion: 2.1 time: 0.200453 Aug 24 16:48:57.006898 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 298/607] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:56 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1760 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:11.308635 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d1760e16-9a82-45b3-b883-1b24978041f3 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:11.309361 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d1760e16-9a82-45b3-b883-1b24978041f3 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:11.311287 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=25 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:11.311938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=32 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:11.318112 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d1760e16-9a82-45b3-b883-1b24978041f3 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:11.318783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d1760e16-9a82-45b3-b883-1b24978041f3 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:11.319215 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d1760e16-9a82-45b3-b883-1b24978041f3 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:11.319909 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d1760e16-9a82-45b3-b883-1b24978041f3 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:11.320380 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d1760e16-9a82-45b3-b883-1b24978041f3 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:11.320805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d1760e16-9a82-45b3-b883-1b24978041f3 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:11.507753 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-d1760e16-9a82-45b3-b883-1b24978041f3 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lazy-loading 'services' on Instance uuid f4e8d907-5a6d-450e-92bc-a4ee16bde539 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:11.724495 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d1760e16-9a82-45b3-b883-1b24978041f3 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments/0fffa87d-ce64-4d56-9b6f-1c8e8bb38821" status: 202 len: 0 microversion: 2.1 time: 0.419653 Aug 24 16:49:11.725202 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 310/608] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:49:11 2022] DELETE /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments/0fffa87d-ce64-4d56-9b6f-1c8e8bb38821 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:49:11.733527 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-4cee4f9c-8fcd-42e8-8f2e-eef67e15a05c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:11.736763 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-4cee4f9c-8fcd-42e8-8f2e-eef67e15a05c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:11.739028 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=7 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:11.739693 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=10 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:11.745545 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4cee4f9c-8fcd-42e8-8f2e-eef67e15a05c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:11.746050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4cee4f9c-8fcd-42e8-8f2e-eef67e15a05c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:11.746527 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4cee4f9c-8fcd-42e8-8f2e-eef67e15a05c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:11.747244 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4cee4f9c-8fcd-42e8-8f2e-eef67e15a05c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:11.747758 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4cee4f9c-8fcd-42e8-8f2e-eef67e15a05c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:11.748131 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4cee4f9c-8fcd-42e8-8f2e-eef67e15a05c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:11.784877 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-4cee4f9c-8fcd-42e8-8f2e-eef67e15a05c tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055235 Aug 24 16:49:11.785457 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 299/609] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:11 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:12.798612 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a95c80ff-0e35-4858-ace4-2034195c196f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:12.801019 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a95c80ff-0e35-4858-ace4-2034195c196f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:12.807424 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a95c80ff-0e35-4858-ace4-2034195c196f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:12.807907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a95c80ff-0e35-4858-ace4-2034195c196f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:12.808355 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a95c80ff-0e35-4858-ace4-2034195c196f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:12.809062 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a95c80ff-0e35-4858-ace4-2034195c196f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:12.809513 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a95c80ff-0e35-4858-ace4-2034195c196f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:12.809944 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a95c80ff-0e35-4858-ace4-2034195c196f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:12.840383 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a95c80ff-0e35-4858-ace4-2034195c196f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046558 Aug 24 16:49:12.840953 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 311/610] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:12 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:13.853507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-526d5d79-8add-47f4-939c-c52fa0b93261 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:13.855675 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-526d5d79-8add-47f4-939c-c52fa0b93261 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:13.862319 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-526d5d79-8add-47f4-939c-c52fa0b93261 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.862904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-526d5d79-8add-47f4-939c-c52fa0b93261 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.863337 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-526d5d79-8add-47f4-939c-c52fa0b93261 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:13.864050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-526d5d79-8add-47f4-939c-c52fa0b93261 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.864528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-526d5d79-8add-47f4-939c-c52fa0b93261 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.865172 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-526d5d79-8add-47f4-939c-c52fa0b93261 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:13.894541 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-526d5d79-8add-47f4-939c-c52fa0b93261 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045553 Aug 24 16:49:13.895122 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 300/611] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:13 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:49:13.973100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9e603f50-41ef-4c84-9c49-b93b30f51b46 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:13.973672 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9e603f50-41ef-4c84-9c49-b93b30f51b46 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:13.980219 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e603f50-41ef-4c84-9c49-b93b30f51b46 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.980741 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e603f50-41ef-4c84-9c49-b93b30f51b46 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.981182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e603f50-41ef-4c84-9c49-b93b30f51b46 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:13.981874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e603f50-41ef-4c84-9c49-b93b30f51b46 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.982411 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e603f50-41ef-4c84-9c49-b93b30f51b46 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.982758 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e603f50-41ef-4c84-9c49-b93b30f51b46 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:14.008536 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9e603f50-41ef-4c84-9c49-b93b30f51b46 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:49:14.292996 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9e603f50-41ef-4c84-9c49-b93b30f51b46 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 204 len: 0 microversion: 2.1 time: 0.324111 Aug 24 16:49:14.293621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 312/612] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:49:13 2022] DELETE /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:14.302079 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-684a4058-05da-4cea-8742-c4d1d67b5f8f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:14.304130 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-684a4058-05da-4cea-8742-c4d1d67b5f8f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:14.308686 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-684a4058-05da-4cea-8742-c4d1d67b5f8f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:14.309163 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-684a4058-05da-4cea-8742-c4d1d67b5f8f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:14.309592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-684a4058-05da-4cea-8742-c4d1d67b5f8f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:14.310299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-684a4058-05da-4cea-8742-c4d1d67b5f8f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:14.310746 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-684a4058-05da-4cea-8742-c4d1d67b5f8f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:14.311164 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-684a4058-05da-4cea-8742-c4d1d67b5f8f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:14.505003 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-684a4058-05da-4cea-8742-c4d1d67b5f8f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:14.509254 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-684a4058-05da-4cea-8742-c4d1d67b5f8f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1690 microversion: 2.1 time: 0.211033 Aug 24 16:49:14.509843 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 301/613] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:14 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1690 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:15.531958 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-419e7183-80dc-438a-9e2b-719f35ce764a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:15.532687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-419e7183-80dc-438a-9e2b-719f35ce764a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:15.539057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419e7183-80dc-438a-9e2b-719f35ce764a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:15.539547 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419e7183-80dc-438a-9e2b-719f35ce764a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:15.539988 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419e7183-80dc-438a-9e2b-719f35ce764a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:15.540704 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419e7183-80dc-438a-9e2b-719f35ce764a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:15.541161 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419e7183-80dc-438a-9e2b-719f35ce764a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:15.546504 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-419e7183-80dc-438a-9e2b-719f35ce764a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:15.683281 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-419e7183-80dc-438a-9e2b-719f35ce764a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:15.692077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-419e7183-80dc-438a-9e2b-719f35ce764a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1690 microversion: 2.1 time: 0.164333 Aug 24 16:49:15.692745 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 313/614] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:15 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:15.999685 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6f55721b-9d1b-4396-b508-9cae45fd177f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:16.000561 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6f55721b-9d1b-4396-b508-9cae45fd177f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:16.007246 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f55721b-9d1b-4396-b508-9cae45fd177f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.008249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f55721b-9d1b-4396-b508-9cae45fd177f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.008720 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f55721b-9d1b-4396-b508-9cae45fd177f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:16.009407 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f55721b-9d1b-4396-b508-9cae45fd177f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.009857 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f55721b-9d1b-4396-b508-9cae45fd177f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.010280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f55721b-9d1b-4396-b508-9cae45fd177f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:16.043630 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6f55721b-9d1b-4396-b508-9cae45fd177f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments/5897f032-0780-41f3-a6b4-97877f9835e4" status: 200 len: 194 microversion: 2.20 time: 0.047957 Aug 24 16:49:16.044228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 302/615] 10.222.0.17 () {60 vars in 1454 bytes} [Wed Aug 24 16:49:15 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments/5897f032-0780-41f3-a6b4-97877f9835e4 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:49:16.116498 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b3e4a9f4-5eb2-4e40-94a9-b9b466d96c28 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:16.117081 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b3e4a9f4-5eb2-4e40-94a9-b9b466d96c28 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:16.123261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3e4a9f4-5eb2-4e40-94a9-b9b466d96c28 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.123738 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3e4a9f4-5eb2-4e40-94a9-b9b466d96c28 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.124167 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3e4a9f4-5eb2-4e40-94a9-b9b466d96c28 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:16.124899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3e4a9f4-5eb2-4e40-94a9-b9b466d96c28 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.125352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3e4a9f4-5eb2-4e40-94a9-b9b466d96c28 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.125767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3e4a9f4-5eb2-4e40-94a9-b9b466d96c28 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:16.226748 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-b3e4a9f4-5eb2-4e40-94a9-b9b466d96c28 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lazy-loading 'services' on Instance uuid 1eadb4fd-bee8-4fac-b072-550b720e3e95 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:16.456602 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b3e4a9f4-5eb2-4e40-94a9-b9b466d96c28 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments/5897f032-0780-41f3-a6b4-97877f9835e4" status: 202 len: 0 microversion: 2.20 time: 0.344031 Aug 24 16:49:16.457148 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 314/616] 10.222.0.17 () {60 vars in 1457 bytes} [Wed Aug 24 16:49:16 2022] DELETE /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments/5897f032-0780-41f3-a6b4-97877f9835e4 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:16.466544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9c5fb672-078a-427c-8476-397449de6480 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:16.469486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9c5fb672-078a-427c-8476-397449de6480 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:16.475744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9c5fb672-078a-427c-8476-397449de6480 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.476230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9c5fb672-078a-427c-8476-397449de6480 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.476709 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9c5fb672-078a-427c-8476-397449de6480 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:16.477414 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9c5fb672-078a-427c-8476-397449de6480 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.477867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9c5fb672-078a-427c-8476-397449de6480 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.478292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9c5fb672-078a-427c-8476-397449de6480 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:16.509447 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9c5fb672-078a-427c-8476-397449de6480 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047420 Aug 24 16:49:16.510012 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 303/617] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 24 16:49:16 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:49:16.715357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6a2ac6a7-6536-4191-ba57-a513eebf3f7a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:16.715990 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6a2ac6a7-6536-4191-ba57-a513eebf3f7a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:16.722573 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a2ac6a7-6536-4191-ba57-a513eebf3f7a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.723063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a2ac6a7-6536-4191-ba57-a513eebf3f7a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.723499 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a2ac6a7-6536-4191-ba57-a513eebf3f7a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:16.724195 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a2ac6a7-6536-4191-ba57-a513eebf3f7a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.724674 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a2ac6a7-6536-4191-ba57-a513eebf3f7a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.729320 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a2ac6a7-6536-4191-ba57-a513eebf3f7a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:16.870117 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6a2ac6a7-6536-4191-ba57-a513eebf3f7a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:16.878644 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6a2ac6a7-6536-4191-ba57-a513eebf3f7a tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1690 microversion: 2.1 time: 0.168159 Aug 24 16:49:16.879199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 315/618] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:16 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:17.222882 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-db121dda-2ae4-42bd-95bf-a196acd31798 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:17.225084 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-db121dda-2ae4-42bd-95bf-a196acd31798 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:17.231530 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db121dda-2ae4-42bd-95bf-a196acd31798 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.232050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db121dda-2ae4-42bd-95bf-a196acd31798 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.232519 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db121dda-2ae4-42bd-95bf-a196acd31798 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.233222 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db121dda-2ae4-42bd-95bf-a196acd31798 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.233712 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db121dda-2ae4-42bd-95bf-a196acd31798 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.234143 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db121dda-2ae4-42bd-95bf-a196acd31798 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.264657 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-db121dda-2ae4-42bd-95bf-a196acd31798 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046983 Aug 24 16:49:17.265225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 304/619] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:17 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:49:17.331237 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-50110c59-5903-4e33-9ad3-b8b0b22f5505 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:17.331781 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-50110c59-5903-4e33-9ad3-b8b0b22f5505 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:17.338863 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50110c59-5903-4e33-9ad3-b8b0b22f5505 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.339341 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50110c59-5903-4e33-9ad3-b8b0b22f5505 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.339805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50110c59-5903-4e33-9ad3-b8b0b22f5505 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.340583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50110c59-5903-4e33-9ad3-b8b0b22f5505 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.340981 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50110c59-5903-4e33-9ad3-b8b0b22f5505 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.341398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50110c59-5903-4e33-9ad3-b8b0b22f5505 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.367046 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-50110c59-5903-4e33-9ad3-b8b0b22f5505 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:49:17.525422 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b1727fca-52c0-4599-92c4-6beaaf82488c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:17.528890 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b1727fca-52c0-4599-92c4-6beaaf82488c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:17.538829 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b1727fca-52c0-4599-92c4-6beaaf82488c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.539702 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b1727fca-52c0-4599-92c4-6beaaf82488c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.540459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b1727fca-52c0-4599-92c4-6beaaf82488c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.542042 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b1727fca-52c0-4599-92c4-6beaaf82488c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.542795 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b1727fca-52c0-4599-92c4-6beaaf82488c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.543501 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b1727fca-52c0-4599-92c4-6beaaf82488c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.577214 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b1727fca-52c0-4599-92c4-6beaaf82488c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058932 Aug 24 16:49:17.577789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 305/620] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 24 16:49:17 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:49:17.658799 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-50110c59-5903-4e33-9ad3-b8b0b22f5505 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 204 len: 0 microversion: 2.1 time: 0.331447 Aug 24 16:49:17.659766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 316/621] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:49:17 2022] DELETE /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:17.668123 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f016200d-3c6d-40a1-ae00-007cce41a9d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:17.671348 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f016200d-3c6d-40a1-ae00-007cce41a9d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:17.675694 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f016200d-3c6d-40a1-ae00-007cce41a9d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.676214 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f016200d-3c6d-40a1-ae00-007cce41a9d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.676673 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f016200d-3c6d-40a1-ae00-007cce41a9d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.677419 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f016200d-3c6d-40a1-ae00-007cce41a9d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.677873 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f016200d-3c6d-40a1-ae00-007cce41a9d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.678291 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f016200d-3c6d-40a1-ae00-007cce41a9d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.811197 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f016200d-3c6d-40a1-ae00-007cce41a9d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:17.823473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f016200d-3c6d-40a1-ae00-007cce41a9d9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1674 microversion: 2.1 time: 0.159064 Aug 24 16:49:17.824068 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 306/622] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:17 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:17.900188 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4bb75fb7-1f73-4f19-ad5d-8f90f5477a03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:17.901285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4bb75fb7-1f73-4f19-ad5d-8f90f5477a03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:17.908659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bb75fb7-1f73-4f19-ad5d-8f90f5477a03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.909142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bb75fb7-1f73-4f19-ad5d-8f90f5477a03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.909577 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bb75fb7-1f73-4f19-ad5d-8f90f5477a03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.910271 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bb75fb7-1f73-4f19-ad5d-8f90f5477a03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.910723 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bb75fb7-1f73-4f19-ad5d-8f90f5477a03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.911143 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bb75fb7-1f73-4f19-ad5d-8f90f5477a03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.052278 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4bb75fb7-1f73-4f19-ad5d-8f90f5477a03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:18.061104 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4bb75fb7-1f73-4f19-ad5d-8f90f5477a03 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1690 microversion: 2.1 time: 0.165487 Aug 24 16:49:18.061648 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 317/623] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:17 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:18.590619 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-008c729b-2b95-4810-bd7f-e147e2a1d78a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:18.592804 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-008c729b-2b95-4810-bd7f-e147e2a1d78a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:18.599125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-008c729b-2b95-4810-bd7f-e147e2a1d78a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.599602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-008c729b-2b95-4810-bd7f-e147e2a1d78a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.600026 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-008c729b-2b95-4810-bd7f-e147e2a1d78a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.600733 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-008c729b-2b95-4810-bd7f-e147e2a1d78a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.601179 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-008c729b-2b95-4810-bd7f-e147e2a1d78a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.601594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-008c729b-2b95-4810-bd7f-e147e2a1d78a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.632144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-008c729b-2b95-4810-bd7f-e147e2a1d78a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045599 Aug 24 16:49:18.632739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 307/624] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 24 16:49:18 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:49:18.847749 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5ec5831f-e22f-4197-a11b-105146f23960 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:18.848406 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5ec5831f-e22f-4197-a11b-105146f23960 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:18.854601 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ec5831f-e22f-4197-a11b-105146f23960 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.855064 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ec5831f-e22f-4197-a11b-105146f23960 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.855508 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ec5831f-e22f-4197-a11b-105146f23960 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.856186 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ec5831f-e22f-4197-a11b-105146f23960 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.856659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ec5831f-e22f-4197-a11b-105146f23960 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.857075 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ec5831f-e22f-4197-a11b-105146f23960 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.986155 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-eed95ff0-02fe-48ac-b453-2aa2327e87ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:18.987023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-eed95ff0-02fe-48ac-b453-2aa2327e87ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:18.995091 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eed95ff0-02fe-48ac-b453-2aa2327e87ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.995571 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eed95ff0-02fe-48ac-b453-2aa2327e87ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.995999 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eed95ff0-02fe-48ac-b453-2aa2327e87ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.996726 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eed95ff0-02fe-48ac-b453-2aa2327e87ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.997226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eed95ff0-02fe-48ac-b453-2aa2327e87ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.997637 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eed95ff0-02fe-48ac-b453-2aa2327e87ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:19.008281 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5ec5831f-e22f-4197-a11b-105146f23960 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:19.017008 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5ec5831f-e22f-4197-a11b-105146f23960 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1674 microversion: 2.1 time: 0.173266 Aug 24 16:49:19.017604 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 318/625] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:18 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:19.027720 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-eed95ff0-02fe-48ac-b453-2aa2327e87ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/ips" status: 200 len: 150 microversion: 2.1 time: 0.043764 Aug 24 16:49:19.027720 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 308/626] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 16:49:18 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:19.085204 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7a2eedd0-dfea-4d3c-ac32-9bcb1b403d1f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:19.085204 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7a2eedd0-dfea-4d3c-ac32-9bcb1b403d1f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:19.093478 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a2eedd0-dfea-4d3c-ac32-9bcb1b403d1f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:19.094587 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a2eedd0-dfea-4d3c-ac32-9bcb1b403d1f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:19.095032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a2eedd0-dfea-4d3c-ac32-9bcb1b403d1f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:19.095760 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a2eedd0-dfea-4d3c-ac32-9bcb1b403d1f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:19.096227 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a2eedd0-dfea-4d3c-ac32-9bcb1b403d1f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:19.096678 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7a2eedd0-dfea-4d3c-ac32-9bcb1b403d1f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:19.253338 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7a2eedd0-dfea-4d3c-ac32-9bcb1b403d1f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:19.262157 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7a2eedd0-dfea-4d3c-ac32-9bcb1b403d1f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1690 microversion: 2.1 time: 0.184201 Aug 24 16:49:19.262728 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 319/627] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:19 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:19.646911 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-de2c4666-1070-45e7-b2ce-c809d2a02051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:19.649143 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-de2c4666-1070-45e7-b2ce-c809d2a02051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:19.655934 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de2c4666-1070-45e7-b2ce-c809d2a02051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:19.658569 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de2c4666-1070-45e7-b2ce-c809d2a02051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:19.658569 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de2c4666-1070-45e7-b2ce-c809d2a02051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:19.658569 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de2c4666-1070-45e7-b2ce-c809d2a02051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:19.658907 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de2c4666-1070-45e7-b2ce-c809d2a02051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:19.659211 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de2c4666-1070-45e7-b2ce-c809d2a02051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:19.695979 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-de2c4666-1070-45e7-b2ce-c809d2a02051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054919 Aug 24 16:49:19.696471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 309/628] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 24 16:49:19 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:49:20.045251 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-66c6c179-4862-4c1a-ae4f-6789e660e869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:20.045878 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-66c6c179-4862-4c1a-ae4f-6789e660e869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:20.053187 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c6c179-4862-4c1a-ae4f-6789e660e869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.053682 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c6c179-4862-4c1a-ae4f-6789e660e869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.054123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c6c179-4862-4c1a-ae4f-6789e660e869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.054826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c6c179-4862-4c1a-ae4f-6789e660e869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.055282 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c6c179-4862-4c1a-ae4f-6789e660e869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.055712 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-66c6c179-4862-4c1a-ae4f-6789e660e869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.195044 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-66c6c179-4862-4c1a-ae4f-6789e660e869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:20.203960 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-66c6c179-4862-4c1a-ae4f-6789e660e869 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1674 microversion: 2.1 time: 0.162083 Aug 24 16:49:20.204634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 320/629] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:20 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:20.287195 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6ee06d3d-75b2-41b5-921e-c7595c101ddd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:20.287820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6ee06d3d-75b2-41b5-921e-c7595c101ddd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:20.294360 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6ee06d3d-75b2-41b5-921e-c7595c101ddd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.294851 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6ee06d3d-75b2-41b5-921e-c7595c101ddd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.295291 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6ee06d3d-75b2-41b5-921e-c7595c101ddd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.295997 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6ee06d3d-75b2-41b5-921e-c7595c101ddd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.296486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6ee06d3d-75b2-41b5-921e-c7595c101ddd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.296911 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6ee06d3d-75b2-41b5-921e-c7595c101ddd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.480658 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-6ee06d3d-75b2-41b5-921e-c7595c101ddd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:20.489322 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6ee06d3d-75b2-41b5-921e-c7595c101ddd tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1690 microversion: 2.1 time: 0.206137 Aug 24 16:49:20.489899 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 310/630] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:20 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1690 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:20.661605 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e576cc38-5ae5-4b28-8d89-7c1c1b3900a9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0548273a-9f64-4b24-8833-f99557056496"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:20.664162 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e576cc38-5ae5-4b28-8d89-7c1c1b3900a9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:20.670331 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e576cc38-5ae5-4b28-8d89-7c1c1b3900a9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.670811 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e576cc38-5ae5-4b28-8d89-7c1c1b3900a9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.671238 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e576cc38-5ae5-4b28-8d89-7c1c1b3900a9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.671930 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e576cc38-5ae5-4b28-8d89-7c1c1b3900a9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.672970 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e576cc38-5ae5-4b28-8d89-7c1c1b3900a9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.676800 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e576cc38-5ae5-4b28-8d89-7c1c1b3900a9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.711753 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6f989652-cd31-4087-9d39-1caafb2a196c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:20.713942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6f989652-cd31-4087-9d39-1caafb2a196c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:20.720997 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f989652-cd31-4087-9d39-1caafb2a196c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.721495 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f989652-cd31-4087-9d39-1caafb2a196c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.721936 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f989652-cd31-4087-9d39-1caafb2a196c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.722637 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f989652-cd31-4087-9d39-1caafb2a196c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.723095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f989652-cd31-4087-9d39-1caafb2a196c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.723525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6f989652-cd31-4087-9d39-1caafb2a196c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.748979 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:20.755758 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6f989652-cd31-4087-9d39-1caafb2a196c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050325 Aug 24 16:49:20.756358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 311/631] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 24 16:49:20 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:49:21.230934 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-061638c0-cc1f-40cf-a7b1-308eb6677ffc tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:21.232532 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-061638c0-cc1f-40cf-a7b1-308eb6677ffc tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:21.246778 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-061638c0-cc1f-40cf-a7b1-308eb6677ffc tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.248027 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-061638c0-cc1f-40cf-a7b1-308eb6677ffc tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.249087 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-061638c0-cc1f-40cf-a7b1-308eb6677ffc tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:21.251317 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-061638c0-cc1f-40cf-a7b1-308eb6677ffc tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.252708 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-061638c0-cc1f-40cf-a7b1-308eb6677ffc tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.253719 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-061638c0-cc1f-40cf-a7b1-308eb6677ffc tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:21.558187 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-061638c0-cc1f-40cf-a7b1-308eb6677ffc tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:21.577315 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-061638c0-cc1f-40cf-a7b1-308eb6677ffc tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1674 microversion: 2.1 time: 0.353001 Aug 24 16:49:21.580435 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 312/632] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:21 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1674 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:21.596413 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e576cc38-5ae5-4b28-8d89-7c1c1b3900a9 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.938522 Aug 24 16:49:21.604726 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 321/633] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:49:20 2022] POST /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments => generated 194 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:49:21.623605 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-62fd7add-5c7d-404b-b0d8-a6be387ba0ec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:21.624674 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-62fd7add-5c7d-404b-b0d8-a6be387ba0ec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:21.633342 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-62fd7add-5c7d-404b-b0d8-a6be387ba0ec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.637942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-62fd7add-5c7d-404b-b0d8-a6be387ba0ec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.637942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-62fd7add-5c7d-404b-b0d8-a6be387ba0ec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:21.637942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-62fd7add-5c7d-404b-b0d8-a6be387ba0ec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.637942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-62fd7add-5c7d-404b-b0d8-a6be387ba0ec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.638841 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-62fd7add-5c7d-404b-b0d8-a6be387ba0ec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:21.770906 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cb9c688d-d65a-4d57-861e-b911e23c05a6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:21.773608 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cb9c688d-d65a-4d57-861e-b911e23c05a6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:21.787378 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb9c688d-d65a-4d57-861e-b911e23c05a6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.788291 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb9c688d-d65a-4d57-861e-b911e23c05a6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.789423 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb9c688d-d65a-4d57-861e-b911e23c05a6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:21.790415 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb9c688d-d65a-4d57-861e-b911e23c05a6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.790881 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb9c688d-d65a-4d57-861e-b911e23c05a6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.791304 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb9c688d-d65a-4d57-861e-b911e23c05a6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:21.830458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cb9c688d-d65a-4d57-861e-b911e23c05a6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064957 Aug 24 16:49:21.831046 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 322/634] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 24 16:49:21 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:21.922278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-62fd7add-5c7d-404b-b0d8-a6be387ba0ec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:21.944154 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-62fd7add-5c7d-404b-b0d8-a6be387ba0ec tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1690 microversion: 2.1 time: 0.361570 Aug 24 16:49:21.945437 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 313/635] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:21 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1690 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:21.953063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b157b4de-b400-4342-98df-daac85f66775 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:21.953877 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b157b4de-b400-4342-98df-daac85f66775 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:21.964769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b157b4de-b400-4342-98df-daac85f66775 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.972874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b157b4de-b400-4342-98df-daac85f66775 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.972874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b157b4de-b400-4342-98df-daac85f66775 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:21.972874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b157b4de-b400-4342-98df-daac85f66775 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.972874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b157b4de-b400-4342-98df-daac85f66775 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.973632 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b157b4de-b400-4342-98df-daac85f66775 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.013326 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b157b4de-b400-4342-98df-daac85f66775 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:49:22.371091 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-d326ca97-2681-47fa-bf8f-facfc606a86c req-5654418e-9274-41e2-9a82-58385ef8bd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e8d907-5a6d-450e-92bc-a4ee16bde539", "name": "network-vif-deleted", "tag": "d972466c-37b3-4485-ba2b-6a1659a3de80"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:22.393743 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d326ca97-2681-47fa-bf8f-facfc606a86c req-5654418e-9274-41e2-9a82-58385ef8bd6b service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.399718 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d326ca97-2681-47fa-bf8f-facfc606a86c req-5654418e-9274-41e2-9a82-58385ef8bd6b service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.399718 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d326ca97-2681-47fa-bf8f-facfc606a86c req-5654418e-9274-41e2-9a82-58385ef8bd6b service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.409585 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b157b4de-b400-4342-98df-daac85f66775 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 204 len: 0 microversion: 2.20 time: 0.459818 Aug 24 16:49:22.418002 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 323/636] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 24 16:49:21 2022] DELETE /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:49:22.418280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-d326ca97-2681-47fa-bf8f-facfc606a86c req-5654418e-9274-41e2-9a82-58385ef8bd6b service nova] Creating event network-vif-deleted:d972466c-37b3-4485-ba2b-6a1659a3de80 for instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 on hv-cinder-73116 Aug 24 16:49:22.430144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-d326ca97-2681-47fa-bf8f-facfc606a86c req-5654418e-9274-41e2-9a82-58385ef8bd6b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061119 Aug 24 16:49:22.432191 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 314/637] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:22.440750 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:22.453003 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:22.470556 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.471669 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.472694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.473649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.474725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.475337 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.615573 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6b8bb822-b7d8-4dd6-9e7c-e2acbafc1a39 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:22.617178 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6b8bb822-b7d8-4dd6-9e7c-e2acbafc1a39 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:22.633310 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b8bb822-b7d8-4dd6-9e7c-e2acbafc1a39 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.633818 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b8bb822-b7d8-4dd6-9e7c-e2acbafc1a39 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.634272 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b8bb822-b7d8-4dd6-9e7c-e2acbafc1a39 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.638304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b8bb822-b7d8-4dd6-9e7c-e2acbafc1a39 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.638908 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b8bb822-b7d8-4dd6-9e7c-e2acbafc1a39 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.640089 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b8bb822-b7d8-4dd6-9e7c-e2acbafc1a39 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.753813 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:22.771827 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-6b8bb822-b7d8-4dd6-9e7c-e2acbafc1a39 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:22.799268 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6b8bb822-b7d8-4dd6-9e7c-e2acbafc1a39 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1607 microversion: 2.1 time: 0.193486 Aug 24 16:49:22.802921 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 315/638] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:22 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1607 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:22.819088 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:22.831104 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:22.835068 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d7f5b906-f356-4fad-a883-5b3c63d505f7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.412812 Aug 24 16:49:22.835568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-16237644-13c6-450c-a0ea-d759d9bf37e1 req-e0bd8aa7-448b-4c6b-a0fb-29c7f92611c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfcc291-21b3-42f0-9398-eeebfa0e9af8", "name": "network-vif-deleted", "tag": "ae79267d-50a6-401e-8b7e-65a6ed48fbc9"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:22.845489 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 324/639] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:22 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:22.849161 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-16237644-13c6-450c-a0ea-d759d9bf37e1 req-e0bd8aa7-448b-4c6b-a0fb-29c7f92611c7 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.849771 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-16237644-13c6-450c-a0ea-d759d9bf37e1 req-e0bd8aa7-448b-4c6b-a0fb-29c7f92611c7 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.850374 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-16237644-13c6-450c-a0ea-d759d9bf37e1 req-e0bd8aa7-448b-4c6b-a0fb-29c7f92611c7 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.864562 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-16237644-13c6-450c-a0ea-d759d9bf37e1 req-e0bd8aa7-448b-4c6b-a0fb-29c7f92611c7 service nova] Creating event network-vif-deleted:ae79267d-50a6-401e-8b7e-65a6ed48fbc9 for instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 on hv-cinder-73116 Aug 24 16:49:22.872893 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-16237644-13c6-450c-a0ea-d759d9bf37e1 req-e0bd8aa7-448b-4c6b-a0fb-29c7f92611c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043747 Aug 24 16:49:22.874467 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 316/640] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:49:22.992427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-428ebe55-5aa1-42af-88cc-d04bc61af367 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:22.993948 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-428ebe55-5aa1-42af-88cc-d04bc61af367 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:23.005724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-428ebe55-5aa1-42af-88cc-d04bc61af367 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.006816 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-428ebe55-5aa1-42af-88cc-d04bc61af367 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.007747 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-428ebe55-5aa1-42af-88cc-d04bc61af367 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.009403 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-428ebe55-5aa1-42af-88cc-d04bc61af367 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.010423 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-428ebe55-5aa1-42af-88cc-d04bc61af367 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.011529 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-428ebe55-5aa1-42af-88cc-d04bc61af367 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.386487 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-428ebe55-5aa1-42af-88cc-d04bc61af367 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:23.398152 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-428ebe55-5aa1-42af-88cc-d04bc61af367 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1330 microversion: 2.1 time: 0.414198 Aug 24 16:49:23.399366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 325/641] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:22 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1330 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:23.844784 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7f24f829-10f0-42a7-a2ac-fb0a760a371a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:23.846336 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7f24f829-10f0-42a7-a2ac-fb0a760a371a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:23.853691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f24f829-10f0-42a7-a2ac-fb0a760a371a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.854670 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f24f829-10f0-42a7-a2ac-fb0a760a371a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.855512 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f24f829-10f0-42a7-a2ac-fb0a760a371a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.856877 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f24f829-10f0-42a7-a2ac-fb0a760a371a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.857766 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f24f829-10f0-42a7-a2ac-fb0a760a371a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.858557 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f24f829-10f0-42a7-a2ac-fb0a760a371a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.868073 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=100 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:23.873154 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:23.873154 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:23.880943 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.881590 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.882135 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.882948 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.884100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.884804 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.017466 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7f24f829-10f0-42a7-a2ac-fb0a760a371a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:24.033743 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7f24f829-10f0-42a7-a2ac-fb0a760a371a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1323 microversion: 2.1 time: 0.195052 Aug 24 16:49:24.035142 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 317/642] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:23 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:24.110436 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:24.120119 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:24.121706 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:24.122953 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e8ad8a3f-ea4d-4c80-928d-c2fa28fbd8f1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1723 microversion: 2.20 time: 0.257383 Aug 24 16:49:24.123576 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 326/643] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:23 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:24.437947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:24.439664 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:24.450377 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.451519 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.452406 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.455061 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.455061 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.455433 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.509903 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.510754 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.511411 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.512124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lazy-loading 'fault' on Instance uuid f4e8d907-5a6d-450e-92bc-a4ee16bde539 {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:24.572038 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:24.587149 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-fb2f2475-8570-490f-8721-17c57b92d7e7 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1335 microversion: 2.1 time: 0.156070 Aug 24 16:49:24.592847 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 318/644] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:24 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1335 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:25.058604 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:25.059212 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:25.066924 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.067431 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.067650 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.068380 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.068830 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.069252 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.101916 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.102444 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.102949 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.103429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lazy-loading 'fault' on Instance uuid fcfcc291-21b3-42f0-9398-eeebfa0e9af8 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:25.146801 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:25.147642 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:25.154211 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.154695 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.155062 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:25.155265 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.155812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.156263 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.156787 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.163931 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-207107f8-1fdb-4bfc-9517-9cb67c8c4d2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 200 len: 1328 microversion: 2.1 time: 0.109276 Aug 24 16:49:25.164543 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 327/645] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:25 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:25.260767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:25.281017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:25.283457 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:25.285107 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-48b54c71-f5e1-4b66-b289-e50cb6c75c44 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1656 microversion: 2.20 time: 0.142748 Aug 24 16:49:25.285780 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 319/646] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:25 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1656 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:25.614256 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-65f62f46-ba5a-4453-a9e3-e6e40e9bedbb req-db5c2994-3097-4f0d-ac72-a8038c4e8cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eadb4fd-bee8-4fac-b072-550b720e3e95", "name": "network-vif-deleted", "tag": "9793be94-7c34-443e-80f4-821b2863ba90"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:25.632370 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:25.633833 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:25.651143 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.657540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.659328 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.661153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.661345 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-65f62f46-ba5a-4453-a9e3-e6e40e9bedbb req-db5c2994-3097-4f0d-ac72-a8038c4e8cf0 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.662492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-65f62f46-ba5a-4453-a9e3-e6e40e9bedbb req-db5c2994-3097-4f0d-ac72-a8038c4e8cf0 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.663491 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.664447 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-65f62f46-ba5a-4453-a9e3-e6e40e9bedbb req-db5c2994-3097-4f0d-ac72-a8038c4e8cf0 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.664938 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.692223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-65f62f46-ba5a-4453-a9e3-e6e40e9bedbb req-db5c2994-3097-4f0d-ac72-a8038c4e8cf0 service nova] Creating event network-vif-deleted:9793be94-7c34-443e-80f4-821b2863ba90 for instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 on hv-cinder-73116 Aug 24 16:49:25.702725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-65f62f46-ba5a-4453-a9e3-e6e40e9bedbb req-db5c2994-3097-4f0d-ac72-a8038c4e8cf0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095081 Aug 24 16:49:25.710152 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 328/647] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:25.720734 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-55251676-4a87-46e4-aae5-96d1cf2070ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:25.730320 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-55251676-4a87-46e4-aae5-96d1cf2070ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:25.730529 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.730529 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.730529 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.730529 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lazy-loading 'fault' on Instance uuid f4e8d907-5a6d-450e-92bc-a4ee16bde539 {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:25.734446 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55251676-4a87-46e4-aae5-96d1cf2070ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.736001 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55251676-4a87-46e4-aae5-96d1cf2070ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.737185 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55251676-4a87-46e4-aae5-96d1cf2070ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.738719 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55251676-4a87-46e4-aae5-96d1cf2070ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.739816 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55251676-4a87-46e4-aae5-96d1cf2070ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.740904 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55251676-4a87-46e4-aae5-96d1cf2070ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.796597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-55251676-4a87-46e4-aae5-96d1cf2070ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lazy-loading 'flavor' on Instance uuid 4b4ea3cd-ed8d-4169-8be6-716b693de76d {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:25.838054 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:25.853869 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-68efde20-31e5-46ae-8b7d-3430066722e9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 200 len: 1335 microversion: 2.1 time: 0.233449 Aug 24 16:49:25.856404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 320/648] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:25 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 1335 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:26.116360 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:49:26.116625 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Wed Aug 24 16:49:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:49:26.193378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:26.196821 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:26.212215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.213495 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.214490 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.216272 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.217339 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.218305 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.235662 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-55251676-4a87-46e4-aae5-96d1cf2070ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "POST /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d/action" status: 202 len: 0 microversion: 2.1 time: 0.522656 Aug 24 16:49:26.237449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 329/649] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:49:25 2022] POST /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:49:26.244130 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] HTTP exception thrown: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Request method failure captured: Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 HTTP/1.1 Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVuSAm5KlbSCH_QNRV76U_n45ZpC6Kno_a1a5BQWoH64F0TyGS0lfulVbmcR4odEfv2HlZFqz_pH7JD40AlmwEVLOzb_z21pySDElxLqvtnhD2YCnAMAIF0nH8pFn3MKF0lBpm86j73vOXnS320llPE2j1VdUsfXeDWzzDbpkLK8PU Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:49:26.246150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b71890b7a23944ee939c4bd13408063f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 4ce12f8401f3479ba14e5e1c3133a71d Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:49:26.249299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': 'fcfcc291-21b3-42f0-9398-eeebfa0e9af8'} Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:26.251966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:49:26.254235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.256881 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Returning 404 to user: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:26.256881 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2c43ba00-c587-446f-88b5-03aa0e6292a2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 404 len: 111 microversion: 2.1 time: 0.064328 Aug 24 16:49:26.256881 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 321/650] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:26 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:26.262555 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-681ef043-993e-4b3d-b464-27ee2cc5fbb0 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:26.263750 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7609c6d4-9ea5-486d-b6aa-53964a70faaa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '.version_select at 0x7f06a6ea9af0>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:26.263930 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-681ef043-993e-4b3d-b464-27ee2cc5fbb0 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:26.272547 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-681ef043-993e-4b3d-b464-27ee2cc5fbb0 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.274237 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-681ef043-993e-4b3d-b464-27ee2cc5fbb0 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.274237 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-681ef043-993e-4b3d-b464-27ee2cc5fbb0 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.275496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-681ef043-993e-4b3d-b464-27ee2cc5fbb0 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.276098 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-681ef043-993e-4b3d-b464-27ee2cc5fbb0 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.276659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-681ef043-993e-4b3d-b464-27ee2cc5fbb0 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.379009 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7609c6d4-9ea5-486d-b6aa-53964a70faaa tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962041066" status: 202 len: 0 microversion: 2.1 time: 0.120544 Aug 24 16:49:26.379923 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 322/651] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 24 16:49:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962041066 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:49:26.397442 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:26.403141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:26.420765 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.423352 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.424289 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.426140 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.427109 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.461693 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.509976 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-681ef043-993e-4b3d-b464-27ee2cc5fbb0 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:26.526503 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-681ef043-993e-4b3d-b464-27ee2cc5fbb0 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.279512 Aug 24 16:49:26.528050 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 330/652] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:26 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:26.617247 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.618453 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.620841 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.621406 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lazy-loading 'fault' on Instance uuid 1eadb4fd-bee8-4fac-b072-550b720e3e95 {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:26.705108 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:26.715423 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:26.717227 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:26.720825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c722c7d8-a599-413f-a811-9a3540a9ca1b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 200 len: 1371 microversion: 2.20 time: 0.338574 Aug 24 16:49:26.721674 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 323/653] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:26 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:26.889687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:26.893616 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: f4e8d907-5a6d-450e-92bc-a4ee16bde539] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:26.915058 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.915922 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.916830 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.924565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.925473 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.926176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.963185 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] HTTP exception thrown: Instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 could not be found. Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Request method failure captured: Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 HTTP/1.1 Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVrq4otjVfNs1uNhZq-g4sAERo3MCXWw2NQYHqborGd7Oaii9xLab3Pt0-8QlH74mIPv8kZJIE-LFWi6PcEjKsGX7UHEsOkoz3dyJSNGRmFq6On_8oypwQPm4-AgYkuvsGAxniLTuRpvFguDpbYuah9Oi7vrOEdpyuVVMqsr3ehiJM Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: c99d97707cc2485284d8d33522ebb918 Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:49:26.965261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c99d97707cc2485284d8d33522ebb918", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: c99d97707cc2485284d8d33522ebb918 Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-ServerRescueNegativeTestJSON-1231782798-project Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 7be50b041b5947d5909ed6ce516ec8bf Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1231782798-project Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 could not be found. Aug 24 16:49:26.968100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': 'f4e8d907-5a6d-450e-92bc-a4ee16bde539'} Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 could not be found. Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:26.970610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 could not be found. Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 could not be found. Aug 24 16:49:26.973392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.977490 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Returning 404 to user: Instance f4e8d907-5a6d-450e-92bc-a4ee16bde539 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:26.977490 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3bf8ee03-eb19-4836-9e79-978065472971 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539" status: 404 len: 111 microversion: 2.1 time: 0.091780 Aug 24 16:49:26.977490 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 331/654] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:26 2022] GET /compute/v2.1/servers/f4e8d907-5a6d-450e-92bc-a4ee16bde539 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:26.983736 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-03084c3b-85e8-4a1b-bb05-a196a1384d50 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '.version_select at 0x7f06a6e8a0d0>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:27.085773 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-03084c3b-85e8-4a1b-bb05-a196a1384d50 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897509407" status: 202 len: 0 microversion: 2.1 time: 0.110734 Aug 24 16:49:27.088567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 324/655] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 24 16:49:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897509407 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:49:27.567848 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3c11b885-5fed-44ae-ad3b-003fb88b4de5 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:27.569037 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3c11b885-5fed-44ae-ad3b-003fb88b4de5 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:27.576506 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c11b885-5fed-44ae-ad3b-003fb88b4de5 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:27.577606 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c11b885-5fed-44ae-ad3b-003fb88b4de5 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:27.578230 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c11b885-5fed-44ae-ad3b-003fb88b4de5 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:27.580032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c11b885-5fed-44ae-ad3b-003fb88b4de5 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:27.580681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c11b885-5fed-44ae-ad3b-003fb88b4de5 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:27.581312 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c11b885-5fed-44ae-ad3b-003fb88b4de5 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:27.762883 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:27.764995 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:27.780802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:27.782511 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:27.783499 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:27.788542 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:27.788542 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:27.788542 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:27.813722 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] HTTP exception thrown: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Request method failure captured: Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 HTTP/1.1 Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlW3A2Z4Gr_7m650eNJevLJRwbdj-fG2G0izi-msGweQQMpanIoQFLiISwhTFLNi7XwTHBav_tdxfj7Ld1MD8TgKaUpzaps9Mwe7dKyHDEW8OUcaTcnw3G4YawdFoTHGNr0Q8Ceu8U0lE7BrBT3YWOmUd6UcPMMKOxjWrxN4GX3EENE Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:49:27.816572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_52f30f320fa04cdfa0e1d4ea9050119c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: fc27435df46542a3ac37e743b6399387 Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:49:27.819358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '1eadb4fd-bee8-4fac-b072-550b720e3e95'} Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:27.820942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:49:27.823518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:27.827053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Returning 404 to user: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:27.828083 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2fd2a95e-79a1-4a75-904c-f2a1698908c6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 404 len: 111 microversion: 2.20 time: 0.072435 Aug 24 16:49:27.834344 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 325/656] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:27 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 16:49:27.845001 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-dfbcfd85-2c1f-434f-9e4c-a05ad6bebaed tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '.version_select at 0x7f06a6efee50>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:27.896437 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3c11b885-5fed-44ae-ad3b-003fb88b4de5 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:27.912898 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3c11b885-5fed-44ae-ad3b-003fb88b4de5 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.350060 Aug 24 16:49:27.913709 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 332/657] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:27 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:27.966637 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-dfbcfd85-2c1f-434f-9e4c-a05ad6bebaed tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-396998910" status: 204 len: 0 microversion: 2.20 time: 0.129944 Aug 24 16:49:27.968322 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 326/658] 10.222.0.17 () {60 vars in 1259 bytes} [Wed Aug 24 16:49:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-396998910 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:49:28.087629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8f873763-0dd9-4c05-986f-e4d3a28a6e96 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Action: 'create', calling method: .version_select at 0x7f06a7464e50>, body: {"keypair": {"name": "tempest-keypair-1397120318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDAp4TlKA2fVC3XZdC2oRaIYRFCuSPk+L33x29v5SdLDcTtZ4xFVePOSlFmJShmcnioz3tImvgWr7es5534ZYU7TqH6pHN4c8UZFHLfTlNa4HpHhEms0gyGyq1H8OtEqg=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:28.104630 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-8f873763-0dd9-4c05-986f-e4d3a28a6e96 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Getting quotas for project b71890b7a23944ee939c4bd13408063f. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:49:28.109174 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-8f873763-0dd9-4c05-986f-e4d3a28a6e96 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Getting quotas for user 4ce12f8401f3479ba14e5e1c3133a71d and project b71890b7a23944ee939c4bd13408063f. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:49:28.237304 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8f873763-0dd9-4c05-986f-e4d3a28a6e96 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152933 Aug 24 16:49:28.238212 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 333/659] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 16:49:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:49:28.962830 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-37aa2462-92ea-4808-abfa-7d7b3700588a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:28.965863 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-37aa2462-92ea-4808-abfa-7d7b3700588a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:28.990621 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37aa2462-92ea-4808-abfa-7d7b3700588a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:28.991369 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37aa2462-92ea-4808-abfa-7d7b3700588a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:28.992163 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37aa2462-92ea-4808-abfa-7d7b3700588a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:28.993701 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37aa2462-92ea-4808-abfa-7d7b3700588a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:28.994739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37aa2462-92ea-4808-abfa-7d7b3700588a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:28.995715 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37aa2462-92ea-4808-abfa-7d7b3700588a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:29.268136 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-37aa2462-92ea-4808-abfa-7d7b3700588a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:29.280820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-37aa2462-92ea-4808-abfa-7d7b3700588a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.340178 Aug 24 16:49:29.281502 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 327/660] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:28 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:29.636123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f4fb8aec-826d-494c-bf4e-8ac87f782ac0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Action: 'create', calling method: .version_select at 0x7f06a74830d0>, body: {"keypair": {"name": "tempest-keypair-316277663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFl+0AN/RAAk5k22wh89qBwfYdIe9f3prJDyaCR9YlbeZjCcc9wniBYk2ROAp9eMBjeS0VCJY+aV+AjGLa65HXMUJoWDwr0nKxz0TGpcQEuMthzfkcJjciVdC0zQ1fcXgw=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:29.657530 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-f4fb8aec-826d-494c-bf4e-8ac87f782ac0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Getting quotas for project 52f30f320fa04cdfa0e1d4ea9050119c. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:49:29.661919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-f4fb8aec-826d-494c-bf4e-8ac87f782ac0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Getting quotas for user fc27435df46542a3ac37e743b6399387 and project 52f30f320fa04cdfa0e1d4ea9050119c. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:49:29.787235 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f4fb8aec-826d-494c-bf4e-8ac87f782ac0 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.155496 Aug 24 16:49:29.788642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 334/661] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Aug 24 16:49:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 16:49:30.310180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1fe61458-c9fc-4caa-b0b7-d6f28296db90 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:30.312270 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1fe61458-c9fc-4caa-b0b7-d6f28296db90 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:30.327225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1fe61458-c9fc-4caa-b0b7-d6f28296db90 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:30.327871 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1fe61458-c9fc-4caa-b0b7-d6f28296db90 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:30.328656 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1fe61458-c9fc-4caa-b0b7-d6f28296db90 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:30.329629 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1fe61458-c9fc-4caa-b0b7-d6f28296db90 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:30.330455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1fe61458-c9fc-4caa-b0b7-d6f28296db90 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:30.332478 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1fe61458-c9fc-4caa-b0b7-d6f28296db90 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:30.658193 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1fe61458-c9fc-4caa-b0b7-d6f28296db90 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:30.674635 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1fe61458-c9fc-4caa-b0b7-d6f28296db90 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.373316 Aug 24 16:49:30.675682 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 328/662] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:30 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:31.542757 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1952012564", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c868f21-48dd-4a80-9b52-b20f081f69bf"}], "security_groups": [{"name": "tempest-securitygroup--1746650277"}], "key_name": "tempest-keypair-1397120318", "user_data": "}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:31.587377 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b74c5818-90a1-4c14-af6e-0eee50017a26 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:31.587836 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b74c5818-90a1-4c14-af6e-0eee50017a26 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:31.598691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b74c5818-90a1-4c14-af6e-0eee50017a26 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:31.599201 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b74c5818-90a1-4c14-af6e-0eee50017a26 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:31.601709 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b74c5818-90a1-4c14-af6e-0eee50017a26 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:31.602855 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b74c5818-90a1-4c14-af6e-0eee50017a26 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:31.604576 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b74c5818-90a1-4c14-af6e-0eee50017a26 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:31.618229 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b74c5818-90a1-4c14-af6e-0eee50017a26 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:31.682019 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b74c5818-90a1-4c14-af6e-0eee50017a26 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Going to try to terminate instance {{(pid=127626) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:49:31.845532 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] validate_networks() for [('3c868f21-48dd-4a80-9b52-b20f081f69bf', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:49:32.104574 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b74c5818-90a1-4c14-af6e-0eee50017a26 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 204 len: 0 microversion: 2.1 time: 0.525289 Aug 24 16:49:32.105736 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 329/663] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:49:31 2022] DELETE /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:32.113916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0fd295de-47b8-495e-b6bd-385f53c68356 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:32.116331 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0fd295de-47b8-495e-b6bd-385f53c68356 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:32.129689 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0fd295de-47b8-495e-b6bd-385f53c68356 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.130537 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0fd295de-47b8-495e-b6bd-385f53c68356 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.131302 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0fd295de-47b8-495e-b6bd-385f53c68356 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.134619 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0fd295de-47b8-495e-b6bd-385f53c68356 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.134619 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0fd295de-47b8-495e-b6bd-385f53c68356 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.134619 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0fd295de-47b8-495e-b6bd-385f53c68356 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.375638 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0fd295de-47b8-495e-b6bd-385f53c68356 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:32.393313 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0fd295de-47b8-495e-b6bd-385f53c68356 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.284688 Aug 24 16:49:32.394810 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 330/664] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:32 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:32.404218 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0548273a-9f64-4b24-8833-f99557056496"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:32.409757 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:32.420714 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.421581 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.422383 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.424783 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.425727 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.426536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.586793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Invalid volume: volume 0548273a-9f64-4b24-8833-f99557056496 is already attached to instances: 75981127-7926-42dc-9ab3-1fe58eaf63e2 Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: POST /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments HTTP/1.1 Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 74 Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:49:32.591552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {"volumeAttachment": {"volumeId": "0548273a-9f64-4b24-8833-f99557056496"}} Aug 24 16:49:32.596820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Invalid volume: volume 0548273a-9f64-4b24-8833-f99557056496 is already attached to instances: 75981127-7926-42dc-9ab3-1fe58eaf63e2 Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'server_id': '75981127-7926-42dc-9ab3-1fe58eaf63e2', 'body': {'volumeAttachment': {'volumeId': '0548273a-9f64-4b24-8833-f99557056496'}}} Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0548273a-9f64-4b24-8833-f99557056496 is already attached to instances: 75981127-7926-42dc-9ab3-1fe58eaf63e2 Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:32.598494 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0548273a-9f64-4b24-8833-f99557056496 is already attached to instances: 75981127-7926-42dc-9ab3-1fe58eaf63e2 Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:32.600666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:32.602245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:32.602245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:32.602245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:32.602245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0548273a-9f64-4b24-8833-f99557056496 is already attached to instances: 75981127-7926-42dc-9ab3-1fe58eaf63e2 Aug 24 16:49:32.602245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:32.602245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 400 to user: Invalid volume: volume 0548273a-9f64-4b24-8833-f99557056496 is already attached to instances: 75981127-7926-42dc-9ab3-1fe58eaf63e2 {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:32.602245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a270ff46-614e-41a0-9355-fe4e991dc8cf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.199646 Aug 24 16:49:32.602245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 331/665] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:49:32 2022] POST /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments => generated 174 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:49:32.609203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1bc32f3f-e620-49d1-b380-a4ffd7246671 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:32.609203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1bc32f3f-e620-49d1-b380-a4ffd7246671 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:32.617170 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1bc32f3f-e620-49d1-b380-a4ffd7246671 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.618009 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1bc32f3f-e620-49d1-b380-a4ffd7246671 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.618778 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1bc32f3f-e620-49d1-b380-a4ffd7246671 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.620154 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1bc32f3f-e620-49d1-b380-a4ffd7246671 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.621140 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1bc32f3f-e620-49d1-b380-a4ffd7246671 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.622179 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1bc32f3f-e620-49d1-b380-a4ffd7246671 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.893067 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:49:32.894769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:49:32.896557 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:49:32.897783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:49:32.898654 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:49:32.924319 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1bc32f3f-e620-49d1-b380-a4ffd7246671 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:32.924907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.924907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.924907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.924907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.925553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.925553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.932335 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1bc32f3f-e620-49d1-b380-a4ffd7246671 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1509 microversion: 2.1 time: 0.332426 Aug 24 16:49:32.933669 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 332/666] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:32 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:32.947506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-be4a60e3-61e7-4a9c-9b99-b74ac34aa7ab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:32.948288 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-be4a60e3-61e7-4a9c-9b99-b74ac34aa7ab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:32.959772 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-be4a60e3-61e7-4a9c-9b99-b74ac34aa7ab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.960666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-be4a60e3-61e7-4a9c-9b99-b74ac34aa7ab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.961463 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-be4a60e3-61e7-4a9c-9b99-b74ac34aa7ab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.962619 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-be4a60e3-61e7-4a9c-9b99-b74ac34aa7ab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.963473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-be4a60e3-61e7-4a9c-9b99-b74ac34aa7ab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.964235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-be4a60e3-61e7-4a9c-9b99-b74ac34aa7ab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.974156 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Getting quotas for project b71890b7a23944ee939c4bd13408063f. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:49:32.979916 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:32.987129 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Getting quotas for user 4ce12f8401f3479ba14e5e1c3133a71d and project b71890b7a23944ee939c4bd13408063f. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:49:33.006038 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:49:33.008875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:49:33.159335 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2e624c2a-5d06-4e25-bbbf-526cee787036 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.713074 Aug 24 16:49:33.160822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 335/667] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:49:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:49:33.193912 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7e3e97ba-bb68-47db-82f2-14f7eb3ad32c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:33.195016 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7e3e97ba-bb68-47db-82f2-14f7eb3ad32c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:33.200959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-be4a60e3-61e7-4a9c-9b99-b74ac34aa7ab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lazy-loading 'services' on Instance uuid 75981127-7926-42dc-9ab3-1fe58eaf63e2 {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:33.301782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7e3e97ba-bb68-47db-82f2-14f7eb3ad32c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:33.327090 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7e3e97ba-bb68-47db-82f2-14f7eb3ad32c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1238 microversion: 2.1 time: 0.140167 Aug 24 16:49:33.329740 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 336/668] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:33 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1238 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:33.441270 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c1f8d0f6-a861-4847-acc3-eeffba80177f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:33.442435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c1f8d0f6-a861-4847-acc3-eeffba80177f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:33.455137 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1f8d0f6-a861-4847-acc3-eeffba80177f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:33.455982 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1f8d0f6-a861-4847-acc3-eeffba80177f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:33.456776 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1f8d0f6-a861-4847-acc3-eeffba80177f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:33.458056 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1f8d0f6-a861-4847-acc3-eeffba80177f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:33.458887 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1f8d0f6-a861-4847-acc3-eeffba80177f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:33.459651 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1f8d0f6-a861-4847-acc3-eeffba80177f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:33.543206 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-be4a60e3-61e7-4a9c-9b99-b74ac34aa7ab tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments/0548273a-9f64-4b24-8833-f99557056496" status: 202 len: 0 microversion: 2.1 time: 0.606233 Aug 24 16:49:33.543577 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 333/669] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:49:32 2022] DELETE /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments/0548273a-9f64-4b24-8833-f99557056496 => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:49:33.562852 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-32406f2f-ac76-4208-a8ec-ae47b20d4a33 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:33.575363 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-32406f2f-ac76-4208-a8ec-ae47b20d4a33 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:33.596582 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32406f2f-ac76-4208-a8ec-ae47b20d4a33 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:33.598569 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32406f2f-ac76-4208-a8ec-ae47b20d4a33 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:33.599617 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32406f2f-ac76-4208-a8ec-ae47b20d4a33 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:33.601507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32406f2f-ac76-4208-a8ec-ae47b20d4a33 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:33.602540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32406f2f-ac76-4208-a8ec-ae47b20d4a33 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:33.603768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32406f2f-ac76-4208-a8ec-ae47b20d4a33 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:33.653316 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:33.663042 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-32406f2f-ac76-4208-a8ec-ae47b20d4a33 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110654 Aug 24 16:49:33.665040 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 334/670] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:33 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:33.715323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c1f8d0f6-a861-4847-acc3-eeffba80177f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:33.728267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c1f8d0f6-a861-4847-acc3-eeffba80177f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.295049 Aug 24 16:49:33.728267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 337/671] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:33 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:33.736760 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-172024034", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f60278e-d02a-47e3-ac82-34477071b70e"}], "security_groups": [{"name": "tempest-securitygroup--603154556"}], "key_name": "tempest-keypair-316277663", "user_data": "}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:33.915973 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.network.neutron [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] validate_networks() for [('6f60278e-d02a-47e3-ac82-34477071b70e', None, None, None, None, None)] {{(pid=127626) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:49:33.989913 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-acc6de84-d92e-4e15-bd11-a001a1b8f9b0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:33.993510 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-acc6de84-d92e-4e15-bd11-a001a1b8f9b0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:34.002597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-acc6de84-d92e-4e15-bd11-a001a1b8f9b0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.003507 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-acc6de84-d92e-4e15-bd11-a001a1b8f9b0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.004305 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-acc6de84-d92e-4e15-bd11-a001a1b8f9b0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.005706 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-acc6de84-d92e-4e15-bd11-a001a1b8f9b0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.006600 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-acc6de84-d92e-4e15-bd11-a001a1b8f9b0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.007404 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-acc6de84-d92e-4e15-bd11-a001a1b8f9b0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.016235 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:34.317962 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-acc6de84-d92e-4e15-bd11-a001a1b8f9b0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:34.336458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-acc6de84-d92e-4e15-bd11-a001a1b8f9b0 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1509 microversion: 2.1 time: 0.354452 Aug 24 16:49:34.355200 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 338/672] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:33 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1509 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:34.370400 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a80e17cd-7c57-4340-9001-792a5e687b3f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:34.371245 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a80e17cd-7c57-4340-9001-792a5e687b3f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:34.513521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a80e17cd-7c57-4340-9001-792a5e687b3f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:34.531036 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a80e17cd-7c57-4340-9001-792a5e687b3f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1238 microversion: 2.1 time: 0.166045 Aug 24 16:49:34.549796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 339/673] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:34 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1238 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:34.678020 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e7ce066e-ef50-4f5f-9b85-c57e8873c749 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:34.686937 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e7ce066e-ef50-4f5f-9b85-c57e8873c749 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:34.694046 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7ce066e-ef50-4f5f-9b85-c57e8873c749 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.698211 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7ce066e-ef50-4f5f-9b85-c57e8873c749 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.698211 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7ce066e-ef50-4f5f-9b85-c57e8873c749 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.698211 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7ce066e-ef50-4f5f-9b85-c57e8873c749 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.698211 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7ce066e-ef50-4f5f-9b85-c57e8873c749 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.698738 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7ce066e-ef50-4f5f-9b85-c57e8873c749 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.706320 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Flavor limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:49:34.709789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Image limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:49:34.709789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Flavor pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:49:34.709789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Image pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:49:34.709789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:49:34.727001 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.727858 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.728601 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.729867 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.730652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.731401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.735191 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e7ce066e-ef50-4f5f-9b85-c57e8873c749 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062175 Aug 24 16:49:34.736432 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 340/674] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:34 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:34.753027 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2a17d9dc-72f9-4a00-bd0c-032004ca9635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:34.753658 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2a17d9dc-72f9-4a00-bd0c-032004ca9635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:34.759860 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a17d9dc-72f9-4a00-bd0c-032004ca9635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.760375 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a17d9dc-72f9-4a00-bd0c-032004ca9635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.760828 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a17d9dc-72f9-4a00-bd0c-032004ca9635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.761115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Getting quotas for project 52f30f320fa04cdfa0e1d4ea9050119c. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:49:34.761537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a17d9dc-72f9-4a00-bd0c-032004ca9635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.761991 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a17d9dc-72f9-4a00-bd0c-032004ca9635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.762423 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a17d9dc-72f9-4a00-bd0c-032004ca9635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.763420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:34.765850 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Getting quotas for user fc27435df46542a3ac37e743b6399387 and project 52f30f320fa04cdfa0e1d4ea9050119c. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:49:34.784384 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Going to run 1 instances... {{(pid=127626) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:49:34.784384 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:49:34.959645 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2de12601-f040-4166-b111-5573e4f97bfc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.229431 Aug 24 16:49:34.961557 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 335/675] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Aug 24 16:49:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 16:49:35.002987 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1e7da39d-b49b-4126-b5ef-a86063471e32 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:35.003527 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1e7da39d-b49b-4126-b5ef-a86063471e32 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:35.027362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2a17d9dc-72f9-4a00-bd0c-032004ca9635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:35.039235 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2a17d9dc-72f9-4a00-bd0c-032004ca9635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.290981 Aug 24 16:49:35.053447 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 341/676] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:34 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:35.130704 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1e7da39d-b49b-4126-b5ef-a86063471e32 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:35.156403 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1e7da39d-b49b-4126-b5ef-a86063471e32 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:35.167615 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1e7da39d-b49b-4126-b5ef-a86063471e32 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:35.176286 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1e7da39d-b49b-4126-b5ef-a86063471e32 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1280 microversion: 2.20 time: 0.199771 Aug 24 16:49:35.184419 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 336/677] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:34 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:35.372000 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-803b18a0-ac0d-4824-82c6-d2f8cfb3b9b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:35.373611 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-803b18a0-ac0d-4824-82c6-d2f8cfb3b9b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:35.386455 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-803b18a0-ac0d-4824-82c6-d2f8cfb3b9b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.389565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-803b18a0-ac0d-4824-82c6-d2f8cfb3b9b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.389565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-803b18a0-ac0d-4824-82c6-d2f8cfb3b9b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.390460 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-803b18a0-ac0d-4824-82c6-d2f8cfb3b9b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.391387 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-803b18a0-ac0d-4824-82c6-d2f8cfb3b9b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.392300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-803b18a0-ac0d-4824-82c6-d2f8cfb3b9b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.568481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8e722574-8e63-49d7-98dd-ec8b99d577b7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:35.570271 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8e722574-8e63-49d7-98dd-ec8b99d577b7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:35.618829 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8e722574-8e63-49d7-98dd-ec8b99d577b7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.621884 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8e722574-8e63-49d7-98dd-ec8b99d577b7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.622663 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8e722574-8e63-49d7-98dd-ec8b99d577b7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.623967 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8e722574-8e63-49d7-98dd-ec8b99d577b7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.624868 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8e722574-8e63-49d7-98dd-ec8b99d577b7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.625937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8e722574-8e63-49d7-98dd-ec8b99d577b7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.676109 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-803b18a0-ac0d-4824-82c6-d2f8cfb3b9b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:35.698003 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-803b18a0-ac0d-4824-82c6-d2f8cfb3b9b2 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1509 microversion: 2.1 time: 0.333965 Aug 24 16:49:35.710280 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 342/678] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:35 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:35.761991 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-946434d8-e4cf-4a3e-9c93-40ce5936f845 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:35.765345 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-946434d8-e4cf-4a3e-9c93-40ce5936f845 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:35.780140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-946434d8-e4cf-4a3e-9c93-40ce5936f845 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.792401 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-946434d8-e4cf-4a3e-9c93-40ce5936f845 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.792401 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-946434d8-e4cf-4a3e-9c93-40ce5936f845 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.792790 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-946434d8-e4cf-4a3e-9c93-40ce5936f845 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.793090 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-946434d8-e4cf-4a3e-9c93-40ce5936f845 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.793523 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-946434d8-e4cf-4a3e-9c93-40ce5936f845 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.803853 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8e722574-8e63-49d7-98dd-ec8b99d577b7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:35.821812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8e722574-8e63-49d7-98dd-ec8b99d577b7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1290 microversion: 2.1 time: 0.261105 Aug 24 16:49:35.823531 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 337/679] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:35 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1290 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:35.833507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-2d16d06c-b7da-41f2-8b57-bf3923c485a6 req-e374002a-3499-409a-b15f-dba867f8b69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5069db3c-2e20-4acd-9be9-f0ffc80832e5", "name": "network-vif-deleted", "tag": "2887267a-02c9-4065-8fb6-a79355822e82"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:35.852913 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-2d16d06c-b7da-41f2-8b57-bf3923c485a6 req-e374002a-3499-409a-b15f-dba867f8b69b service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.867124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-2d16d06c-b7da-41f2-8b57-bf3923c485a6 req-e374002a-3499-409a-b15f-dba867f8b69b service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.867124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-2d16d06c-b7da-41f2-8b57-bf3923c485a6 req-e374002a-3499-409a-b15f-dba867f8b69b service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.867515 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-946434d8-e4cf-4a3e-9c93-40ce5936f845 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118325 Aug 24 16:49:35.867515 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 343/680] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:35 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:49:35.878253 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-2d16d06c-b7da-41f2-8b57-bf3923c485a6 req-e374002a-3499-409a-b15f-dba867f8b69b service nova] Creating event network-vif-deleted:2887267a-02c9-4065-8fb6-a79355822e82 for instance 5069db3c-2e20-4acd-9be9-f0ffc80832e5 on hv-cinder-73116 Aug 24 16:49:35.884916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-2d16d06c-b7da-41f2-8b57-bf3923c485a6 req-e374002a-3499-409a-b15f-dba867f8b69b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059423 Aug 24 16:49:35.885521 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 338/681] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:35.990996 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3a856420-111d-4fc0-8c06-173253f844f6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:35.991967 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3a856420-111d-4fc0-8c06-173253f844f6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:36.003141 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a856420-111d-4fc0-8c06-173253f844f6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.013421 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a856420-111d-4fc0-8c06-173253f844f6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.013421 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a856420-111d-4fc0-8c06-173253f844f6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.013421 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a856420-111d-4fc0-8c06-173253f844f6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.013421 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a856420-111d-4fc0-8c06-173253f844f6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.014924 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a856420-111d-4fc0-8c06-173253f844f6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.055738 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3a856420-111d-4fc0-8c06-173253f844f6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:49:36.065820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-af72e61a-3670-4743-862e-6f3a7c6e5ad8 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:36.067129 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-af72e61a-3670-4743-862e-6f3a7c6e5ad8 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:36.076397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af72e61a-3670-4743-862e-6f3a7c6e5ad8 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.076909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af72e61a-3670-4743-862e-6f3a7c6e5ad8 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.077443 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af72e61a-3670-4743-862e-6f3a7c6e5ad8 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.078201 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af72e61a-3670-4743-862e-6f3a7c6e5ad8 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.081575 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af72e61a-3670-4743-862e-6f3a7c6e5ad8 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.082490 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-af72e61a-3670-4743-862e-6f3a7c6e5ad8 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.296422 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-af72e61a-3670-4743-862e-6f3a7c6e5ad8 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:36.306716 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-af72e61a-3670-4743-862e-6f3a7c6e5ad8 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.246719 Aug 24 16:49:36.307484 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 339/682] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:36 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:36.314651 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d24996d5-9e85-41e1-8ff4-e9fc0730cf33 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:36.315404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d24996d5-9e85-41e1-8ff4-e9fc0730cf33 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:36.388604 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d24996d5-9e85-41e1-8ff4-e9fc0730cf33 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:36.402226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d24996d5-9e85-41e1-8ff4-e9fc0730cf33 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:36.406133 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d24996d5-9e85-41e1-8ff4-e9fc0730cf33 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:36.408410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d24996d5-9e85-41e1-8ff4-e9fc0730cf33 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1280 microversion: 2.20 time: 0.099307 Aug 24 16:49:36.413826 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 340/683] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:36 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:36.463772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3a856420-111d-4fc0-8c06-173253f844f6 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 204 len: 0 microversion: 2.1 time: 0.481129 Aug 24 16:49:36.466159 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 344/684] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:49:35 2022] DELETE /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:36.477560 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-11ea7cc5-2590-45e6-aad2-689042aedf3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:36.478440 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-11ea7cc5-2590-45e6-aad2-689042aedf3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:36.487503 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-11ea7cc5-2590-45e6-aad2-689042aedf3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.488277 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-11ea7cc5-2590-45e6-aad2-689042aedf3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.489459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-11ea7cc5-2590-45e6-aad2-689042aedf3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.490429 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-11ea7cc5-2590-45e6-aad2-689042aedf3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.491219 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-11ea7cc5-2590-45e6-aad2-689042aedf3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.491929 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-11ea7cc5-2590-45e6-aad2-689042aedf3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.745101 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-11ea7cc5-2590-45e6-aad2-689042aedf3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:36.751967 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:36.753216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:36.761190 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-11ea7cc5-2590-45e6-aad2-689042aedf3a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1683 microversion: 2.1 time: 0.287260 Aug 24 16:49:36.762244 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 341/685] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:36 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1683 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:36.764434 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.765287 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.766089 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.767599 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.768474 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.769227 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.825418 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.825908 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.826337 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.826775 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lazy-loading 'fault' on Instance uuid 5069db3c-2e20-4acd-9be9-f0ffc80832e5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:36.846366 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7f8e4282-807c-4124-a675-15e1df2cc80f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:36.847812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7f8e4282-807c-4124-a675-15e1df2cc80f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:36.855088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f8e4282-807c-4124-a675-15e1df2cc80f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.855641 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f8e4282-807c-4124-a675-15e1df2cc80f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.856308 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f8e4282-807c-4124-a675-15e1df2cc80f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.857273 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f8e4282-807c-4124-a675-15e1df2cc80f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.865179 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f8e4282-807c-4124-a675-15e1df2cc80f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.865179 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7f8e4282-807c-4124-a675-15e1df2cc80f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.895582 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:36.912777 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-92376593-663e-45b9-bead-79b49f8da923 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1312 microversion: 2.1 time: 0.167563 Aug 24 16:49:36.914076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 345/686] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:36 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:36.959387 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-7f8e4282-807c-4124-a675-15e1df2cc80f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:36.973807 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7f8e4282-807c-4124-a675-15e1df2cc80f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1298 microversion: 2.1 time: 0.132237 Aug 24 16:49:36.974739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 342/687] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:36 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:37.358477 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d21fadb7-dd6a-4910-91f9-c167fd999479 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:37.359440 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d21fadb7-dd6a-4910-91f9-c167fd999479 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:37.378707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d21fadb7-dd6a-4910-91f9-c167fd999479 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.379418 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d21fadb7-dd6a-4910-91f9-c167fd999479 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.380107 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d21fadb7-dd6a-4910-91f9-c167fd999479 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.381093 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d21fadb7-dd6a-4910-91f9-c167fd999479 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.381720 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d21fadb7-dd6a-4910-91f9-c167fd999479 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.382268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d21fadb7-dd6a-4910-91f9-c167fd999479 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.446873 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:37.447652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:37.457374 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.458187 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.458919 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.460117 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.461135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.461899 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.566858 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:37.580697 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:37.584446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:37.585967 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-4eb19396-2d8d-4ced-adf0-9ea7738b9203 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1284 microversion: 2.20 time: 0.143994 Aug 24 16:49:37.586950 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 343/688] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:37 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:37.589183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d21fadb7-dd6a-4910-91f9-c167fd999479 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:37.603353 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d21fadb7-dd6a-4910-91f9-c167fd999479 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.251671 Aug 24 16:49:37.604811 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 346/689] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:37 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:37.802107 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ce4e5d98-93fa-450e-992f-50c32e752b69 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:37.803215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ce4e5d98-93fa-450e-992f-50c32e752b69 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:37.814284 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce4e5d98-93fa-450e-992f-50c32e752b69 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.819570 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce4e5d98-93fa-450e-992f-50c32e752b69 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.819570 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce4e5d98-93fa-450e-992f-50c32e752b69 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.819570 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce4e5d98-93fa-450e-992f-50c32e752b69 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.819570 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce4e5d98-93fa-450e-992f-50c32e752b69 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.820201 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce4e5d98-93fa-450e-992f-50c32e752b69 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.941540 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:37.942658 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:37.956565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.957427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.958437 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.959680 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.961064 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.962181 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.995655 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ce4e5d98-93fa-450e-992f-50c32e752b69 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:38.008318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.009198 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.009998 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.011052 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ce4e5d98-93fa-450e-992f-50c32e752b69 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1683 microversion: 2.1 time: 0.215937 Aug 24 16:49:38.011318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lazy-loading 'fault' on Instance uuid 5069db3c-2e20-4acd-9be9-f0ffc80832e5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:38.016555 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 344/690] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:37 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1683 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:38.028896 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-bb97155d-fee6-4d0e-ba71-196d0d379dc9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:38.030770 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-bb97155d-fee6-4d0e-ba71-196d0d379dc9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:38.043558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb97155d-fee6-4d0e-ba71-196d0d379dc9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.045038 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb97155d-fee6-4d0e-ba71-196d0d379dc9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.046050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb97155d-fee6-4d0e-ba71-196d0d379dc9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.047452 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb97155d-fee6-4d0e-ba71-196d0d379dc9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.048598 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb97155d-fee6-4d0e-ba71-196d0d379dc9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.049665 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bb97155d-fee6-4d0e-ba71-196d0d379dc9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.103458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:38.119765 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c92dc772-07db-4ce3-bafb-fc7c484e699f tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 200 len: 1312 microversion: 2.1 time: 0.187126 Aug 24 16:49:38.121324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 347/691] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:37 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:38.182828 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-bb97155d-fee6-4d0e-ba71-196d0d379dc9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:38.199135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-bb97155d-fee6-4d0e-ba71-196d0d379dc9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1308 microversion: 2.1 time: 0.185596 Aug 24 16:49:38.200762 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 345/692] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:38 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:38.623865 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:38.624702 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:38.632613 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-69041784-1662-4fca-9269-413c02bf5635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:38.633738 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-69041784-1662-4fca-9269-413c02bf5635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:38.644126 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.645821 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69041784-1662-4fca-9269-413c02bf5635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.646564 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69041784-1662-4fca-9269-413c02bf5635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.647218 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69041784-1662-4fca-9269-413c02bf5635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.648193 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69041784-1662-4fca-9269-413c02bf5635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.648894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69041784-1662-4fca-9269-413c02bf5635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.650319 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-69041784-1662-4fca-9269-413c02bf5635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.650558 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.651362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.652670 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.653535 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.656556 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.171415 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:39.190582 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:39.195818 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:39.198241 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4c779050-c302-4516-ba67-0c0a0e777f41 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1332 microversion: 2.20 time: 0.584809 Aug 24 16:49:39.198827 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 348/693] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:38 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1332 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:39.204691 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b979541f-82ca-4a0b-be31-08a54134ed8d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:39.205872 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b979541f-82ca-4a0b-be31-08a54134ed8d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:39.236910 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b979541f-82ca-4a0b-be31-08a54134ed8d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.237580 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b979541f-82ca-4a0b-be31-08a54134ed8d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.238020 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b979541f-82ca-4a0b-be31-08a54134ed8d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.238749 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b979541f-82ca-4a0b-be31-08a54134ed8d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.239257 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b979541f-82ca-4a0b-be31-08a54134ed8d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.239674 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b979541f-82ca-4a0b-be31-08a54134ed8d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.588249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-69041784-1662-4fca-9269-413c02bf5635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:39.604449 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-69041784-1662-4fca-9269-413c02bf5635 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.978580 Aug 24 16:49:39.605633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 346/694] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:38 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:39.614213 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:39.615847 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 5069db3c-2e20-4acd-9be9-f0ffc80832e5] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:39.627233 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.633937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.633937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.634679 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.635885 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.637144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.668571 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] HTTP exception thrown: Instance 5069db3c-2e20-4acd-9be9-f0ffc80832e5 could not be found. Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Request method failure captured: Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 HTTP/1.1 Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVrq4otjVfNs1uNhZq-g4sAERo3MCXWw2NQYHqborGd7Oaii9xLab3Pt0-8QlH74mIPv8kZJIE-LFWi6PcEjKsGX7UHEsOkoz3dyJSNGRmFq6On_8oypwQPm4-AgYkuvsGAxniLTuRpvFguDpbYuah9Oi7vrOEdpyuVVMqsr3ehiJM Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: c99d97707cc2485284d8d33522ebb918 Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:49:39.672180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c99d97707cc2485284d8d33522ebb918", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: c99d97707cc2485284d8d33522ebb918 Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-ServerRescueNegativeTestJSON-1231782798-project Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 7be50b041b5947d5909ed6ce516ec8bf Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1231782798-project Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 5069db3c-2e20-4acd-9be9-f0ffc80832e5 could not be found. Aug 24 16:49:39.686846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '5069db3c-2e20-4acd-9be9-f0ffc80832e5'} Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5069db3c-2e20-4acd-9be9-f0ffc80832e5 could not be found. Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:39.688409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5069db3c-2e20-4acd-9be9-f0ffc80832e5 could not be found. Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5069db3c-2e20-4acd-9be9-f0ffc80832e5 could not be found. Aug 24 16:49:39.691228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:39.694410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Returning 404 to user: Instance 5069db3c-2e20-4acd-9be9-f0ffc80832e5 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:39.694410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b62a90fb-b06d-4f7c-bfad-7a357847fd70 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5" status: 404 len: 111 microversion: 2.1 time: 0.066571 Aug 24 16:49:39.694410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 347/695] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:39 2022] GET /compute/v2.1/servers/5069db3c-2e20-4acd-9be9-f0ffc80832e5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:39.694410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ff4c6423-35e2-4ccb-8b1e-98a6525901f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:39.694410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ff4c6423-35e2-4ccb-8b1e-98a6525901f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:39.695486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff4c6423-35e2-4ccb-8b1e-98a6525901f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.695486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff4c6423-35e2-4ccb-8b1e-98a6525901f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.695486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff4c6423-35e2-4ccb-8b1e-98a6525901f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.695486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff4c6423-35e2-4ccb-8b1e-98a6525901f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.696657 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff4c6423-35e2-4ccb-8b1e-98a6525901f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.696657 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ff4c6423-35e2-4ccb-8b1e-98a6525901f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.904677 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b979541f-82ca-4a0b-be31-08a54134ed8d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:39.916964 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b979541f-82ca-4a0b-be31-08a54134ed8d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1683 microversion: 2.1 time: 0.716177 Aug 24 16:49:39.917894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 349/696] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:39 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1683 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:39.923461 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-23a3e1a7-7df9-427c-9f2d-31e5f0138ea4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:39.924438 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-23a3e1a7-7df9-427c-9f2d-31e5f0138ea4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:39.932288 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23a3e1a7-7df9-427c-9f2d-31e5f0138ea4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.933354 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23a3e1a7-7df9-427c-9f2d-31e5f0138ea4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.934009 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23a3e1a7-7df9-427c-9f2d-31e5f0138ea4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.934962 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23a3e1a7-7df9-427c-9f2d-31e5f0138ea4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.936207 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23a3e1a7-7df9-427c-9f2d-31e5f0138ea4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.936854 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23a3e1a7-7df9-427c-9f2d-31e5f0138ea4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.996536 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-23a3e1a7-7df9-427c-9f2d-31e5f0138ea4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:49:40.320937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ff4c6423-35e2-4ccb-8b1e-98a6525901f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:40.356153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ff4c6423-35e2-4ccb-8b1e-98a6525901f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1364 microversion: 2.1 time: 0.679961 Aug 24 16:49:40.359428 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 348/697] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:39 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1364 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:40.392476 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9d09a837-335e-47a4-b0d7-85a6fbde30ea tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1776266205"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:40.393522 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9d09a837-335e-47a4-b0d7-85a6fbde30ea tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:40.403897 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d09a837-335e-47a4-b0d7-85a6fbde30ea tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.405272 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d09a837-335e-47a4-b0d7-85a6fbde30ea tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.405783 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d09a837-335e-47a4-b0d7-85a6fbde30ea tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:40.407042 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d09a837-335e-47a4-b0d7-85a6fbde30ea tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.407970 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d09a837-335e-47a4-b0d7-85a6fbde30ea tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.409008 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9d09a837-335e-47a4-b0d7-85a6fbde30ea tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:40.463357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-23a3e1a7-7df9-427c-9f2d-31e5f0138ea4 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "DELETE /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 204 len: 0 microversion: 2.1 time: 0.543347 Aug 24 16:49:40.474687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 350/698] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:49:39 2022] DELETE /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:40.492263 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:40.493918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:40.503324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.503832 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.504269 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:40.505307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.505783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.506211 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:40.724067 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:40.729533 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:40.740893 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:40.743515 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:40.746594 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-14b85296-3fd7-4ec0-aacb-856f0ab4524e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1338 microversion: 2.20 time: 0.273567 Aug 24 16:49:40.747972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 351/699] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:40 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1338 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:40.790107 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-417ae936-7ab3-4879-9af6-edd2ff9fe470 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:40.791638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-417ae936-7ab3-4879-9af6-edd2ff9fe470 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:40.808506 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-417ae936-7ab3-4879-9af6-edd2ff9fe470 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.809556 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-417ae936-7ab3-4879-9af6-edd2ff9fe470 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.810458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-417ae936-7ab3-4879-9af6-edd2ff9fe470 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:40.811826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-417ae936-7ab3-4879-9af6-edd2ff9fe470 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.812816 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-417ae936-7ab3-4879-9af6-edd2ff9fe470 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.813743 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-417ae936-7ab3-4879-9af6-edd2ff9fe470 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:41.132519 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.network.security_group_api [None req-9d09a837-335e-47a4-b0d7-85a6fbde30ea tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Removing security group 0ea5fd7c-f51c-4882-ae2d-3e7a1c9d4866 from port e178d836-24a2-4e3a-8f28-a62c7fb35528 Aug 24 16:49:41.386035 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-417ae936-7ab3-4879-9af6-edd2ff9fe470 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:41.448873 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-417ae936-7ab3-4879-9af6-edd2ff9fe470 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.677611 Aug 24 16:49:41.454594 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 352/700] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:40 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:41.510659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-03934637-e4e9-42e0-bd00-a8aac4b36feb tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:41.510659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-03934637-e4e9-42e0-bd00-a8aac4b36feb tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:41.510659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03934637-e4e9-42e0-bd00-a8aac4b36feb tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:41.510659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03934637-e4e9-42e0-bd00-a8aac4b36feb tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:41.511442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03934637-e4e9-42e0-bd00-a8aac4b36feb tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:41.511442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03934637-e4e9-42e0-bd00-a8aac4b36feb tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:41.511442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03934637-e4e9-42e0-bd00-a8aac4b36feb tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:41.511442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03934637-e4e9-42e0-bd00-a8aac4b36feb tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:41.822382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-03934637-e4e9-42e0-bd00-a8aac4b36feb tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:41.839365 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-03934637-e4e9-42e0-bd00-a8aac4b36feb tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.383176 Aug 24 16:49:41.842619 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 353/701] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:41 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:41.851905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1206ace3-5b81-4764-b68f-4b06c1b51a79 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:41.857164 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1206ace3-5b81-4764-b68f-4b06c1b51a79 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:41.874064 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1206ace3-5b81-4764-b68f-4b06c1b51a79 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:41.875371 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1206ace3-5b81-4764-b68f-4b06c1b51a79 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:41.876092 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1206ace3-5b81-4764-b68f-4b06c1b51a79 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:41.879025 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1206ace3-5b81-4764-b68f-4b06c1b51a79 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:41.880249 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1206ace3-5b81-4764-b68f-4b06c1b51a79 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:41.881376 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1206ace3-5b81-4764-b68f-4b06c1b51a79 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.019445 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1206ace3-5b81-4764-b68f-4b06c1b51a79 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:42.035069 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1206ace3-5b81-4764-b68f-4b06c1b51a79 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1615 microversion: 2.1 time: 0.190373 Aug 24 16:49:42.036616 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 354/702] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:41 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1615 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:42.043118 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-defe43ef-7b3c-440c-a375-8f5f318b4852 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:42.043903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-defe43ef-7b3c-440c-a375-8f5f318b4852 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:42.053139 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-defe43ef-7b3c-440c-a375-8f5f318b4852 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.054156 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-defe43ef-7b3c-440c-a375-8f5f318b4852 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.055051 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-defe43ef-7b3c-440c-a375-8f5f318b4852 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.056623 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-defe43ef-7b3c-440c-a375-8f5f318b4852 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.057772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-defe43ef-7b3c-440c-a375-8f5f318b4852 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.058667 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-defe43ef-7b3c-440c-a375-8f5f318b4852 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.251661 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9d09a837-335e-47a4-b0d7-85a6fbde30ea tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "POST /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/action" status: 202 len: 0 microversion: 2.1 time: 1.887401 Aug 24 16:49:42.253699 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 349/703] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:49:40 2022] POST /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/action => generated 0 bytes in 1891 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:49:42.270657 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-91dfe92a-d220-4bfd-9bda-7a4f6fcaa3e6 req-32fdc2af-99c4-48f0-bf7b-122a977648e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75981127-7926-42dc-9ab3-1fe58eaf63e2", "name": "network-vif-deleted", "tag": "ecde38d2-23a1-4f3d-83ab-8455ae18aa78"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:42.306238 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-91dfe92a-d220-4bfd-9bda-7a4f6fcaa3e6 req-32fdc2af-99c4-48f0-bf7b-122a977648e5 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.307335 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-91dfe92a-d220-4bfd-9bda-7a4f6fcaa3e6 req-32fdc2af-99c4-48f0-bf7b-122a977648e5 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.313394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-91dfe92a-d220-4bfd-9bda-7a4f6fcaa3e6 req-32fdc2af-99c4-48f0-bf7b-122a977648e5 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.367069 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-91dfe92a-d220-4bfd-9bda-7a4f6fcaa3e6 req-32fdc2af-99c4-48f0-bf7b-122a977648e5 service nova] Creating event network-vif-deleted:ecde38d2-23a1-4f3d-83ab-8455ae18aa78 for instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 on hv-cinder-73116 Aug 24 16:49:42.380712 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-91dfe92a-d220-4bfd-9bda-7a4f6fcaa3e6 req-32fdc2af-99c4-48f0-bf7b-122a977648e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124593 Aug 24 16:49:42.382124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 350/704] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:42.414846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:42.416679 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:42.430203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.431709 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.432914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.434842 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.435951 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.437028 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.498400 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-defe43ef-7b3c-440c-a375-8f5f318b4852 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:42.525412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-defe43ef-7b3c-440c-a375-8f5f318b4852 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1364 microversion: 2.1 time: 0.487300 Aug 24 16:49:42.526870 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 355/705] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:42 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1364 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:42.540426 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-94a10b7f-a69a-40bc-9bec-6ac5be2c506c req-71a938f3-4e18-4334-a985-aac72fd8ce24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b9c747-048e-4478-b065-0bd606ea331a", "tag": "01448d18-9692-445d-a2e1-37cc9a89b059"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:42.585551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-94a10b7f-a69a-40bc-9bec-6ac5be2c506c req-71a938f3-4e18-4334-a985-aac72fd8ce24 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.586377 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-94a10b7f-a69a-40bc-9bec-6ac5be2c506c req-71a938f3-4e18-4334-a985-aac72fd8ce24 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.587261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-94a10b7f-a69a-40bc-9bec-6ac5be2c506c req-71a938f3-4e18-4334-a985-aac72fd8ce24 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.614388 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-94a10b7f-a69a-40bc-9bec-6ac5be2c506c req-71a938f3-4e18-4334-a985-aac72fd8ce24 service nova] Creating event network-changed:01448d18-9692-445d-a2e1-37cc9a89b059 for instance 09b9c747-048e-4478-b065-0bd606ea331a on hv-cinder-73116 Aug 24 16:49:42.622780 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-94a10b7f-a69a-40bc-9bec-6ac5be2c506c req-71a938f3-4e18-4334-a985-aac72fd8ce24 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089418 Aug 24 16:49:42.624470 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 356/706] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:42.632752 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e07d2366-e4ae-4e58-9e62-331be1ffe8d9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:42.633679 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e07d2366-e4ae-4e58-9e62-331be1ffe8d9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:42.640790 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e07d2366-e4ae-4e58-9e62-331be1ffe8d9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.641668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e07d2366-e4ae-4e58-9e62-331be1ffe8d9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.642864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e07d2366-e4ae-4e58-9e62-331be1ffe8d9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.647762 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e07d2366-e4ae-4e58-9e62-331be1ffe8d9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.648878 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e07d2366-e4ae-4e58-9e62-331be1ffe8d9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.649870 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e07d2366-e4ae-4e58-9e62-331be1ffe8d9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.857533 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:42.868869 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:42.870548 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:42.872043 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-acb14eed-43ef-4f25-9ea3-b4ba03d9da3e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1405 microversion: 2.20 time: 0.486391 Aug 24 16:49:42.872755 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 351/707] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:42 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:42.880807 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3dac9170-ba86-4242-9436-de198009a688 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:42.881730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3dac9170-ba86-4242-9436-de198009a688 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:42.900488 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dac9170-ba86-4242-9436-de198009a688 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.901357 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dac9170-ba86-4242-9436-de198009a688 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.902029 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dac9170-ba86-4242-9436-de198009a688 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.903121 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dac9170-ba86-4242-9436-de198009a688 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.903808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dac9170-ba86-4242-9436-de198009a688 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.904288 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dac9170-ba86-4242-9436-de198009a688 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.942641 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:43.060592 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e07d2366-e4ae-4e58-9e62-331be1ffe8d9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:43.083503 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e07d2366-e4ae-4e58-9e62-331be1ffe8d9 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.447405 Aug 24 16:49:43.083503 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 357/708] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:42 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:43.093453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d466b60e-7165-4e66-b99f-9e4c1e260adc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:43.094081 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d466b60e-7165-4e66-b99f-9e4c1e260adc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:43.133183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d466b60e-7165-4e66-b99f-9e4c1e260adc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.134396 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d466b60e-7165-4e66-b99f-9e4c1e260adc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.136850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d466b60e-7165-4e66-b99f-9e4c1e260adc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.140298 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d466b60e-7165-4e66-b99f-9e4c1e260adc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.143390 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d466b60e-7165-4e66-b99f-9e4c1e260adc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.148003 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d466b60e-7165-4e66-b99f-9e4c1e260adc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.297225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3dac9170-ba86-4242-9436-de198009a688 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:43.306864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d466b60e-7165-4e66-b99f-9e4c1e260adc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:43.316556 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d466b60e-7165-4e66-b99f-9e4c1e260adc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1615 microversion: 2.1 time: 0.226941 Aug 24 16:49:43.325903 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3dac9170-ba86-4242-9436-de198009a688 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.449486 Aug 24 16:49:43.329141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 352/709] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:42 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:43.337749 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 358/710] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:43 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1615 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:43.558045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-37a07e65-c880-4977-be7c-fd765bc67eb7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:43.559134 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-37a07e65-c880-4977-be7c-fd765bc67eb7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:43.570584 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37a07e65-c880-4977-be7c-fd765bc67eb7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.571481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37a07e65-c880-4977-be7c-fd765bc67eb7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.572607 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37a07e65-c880-4977-be7c-fd765bc67eb7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.573924 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37a07e65-c880-4977-be7c-fd765bc67eb7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.574810 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37a07e65-c880-4977-be7c-fd765bc67eb7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.575621 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-37a07e65-c880-4977-be7c-fd765bc67eb7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.825985 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-37a07e65-c880-4977-be7c-fd765bc67eb7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:43.846104 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-37a07e65-c880-4977-be7c-fd765bc67eb7 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1364 microversion: 2.1 time: 0.294780 Aug 24 16:49:43.847043 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 353/711] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:43 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:43.916263 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:43.918443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:43.931290 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.932159 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.932980 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.934246 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.935342 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.936521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.107816 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3dad8553-3986-46dd-9f38-b90b17022512 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:44.108556 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3dad8553-3986-46dd-9f38-b90b17022512 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:44.119418 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dad8553-3986-46dd-9f38-b90b17022512 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.120745 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dad8553-3986-46dd-9f38-b90b17022512 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.121730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dad8553-3986-46dd-9f38-b90b17022512 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.122605 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dad8553-3986-46dd-9f38-b90b17022512 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.123239 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dad8553-3986-46dd-9f38-b90b17022512 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.123847 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3dad8553-3986-46dd-9f38-b90b17022512 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.372753 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:44.385961 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:44.388737 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:44.390677 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-46ff0e4c-fb31-4f1c-abad-04f1577eef8a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1405 microversion: 2.20 time: 0.483134 Aug 24 16:49:44.391680 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 359/712] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:43 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:44.399819 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cfb11cd6-3b63-4b39-bd80-e0ea13f0bf71 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:44.404389 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cfb11cd6-3b63-4b39-bd80-e0ea13f0bf71 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:44.415214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cfb11cd6-3b63-4b39-bd80-e0ea13f0bf71 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.416946 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cfb11cd6-3b63-4b39-bd80-e0ea13f0bf71 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.417938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cfb11cd6-3b63-4b39-bd80-e0ea13f0bf71 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.420040 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cfb11cd6-3b63-4b39-bd80-e0ea13f0bf71 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.420533 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cfb11cd6-3b63-4b39-bd80-e0ea13f0bf71 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.421309 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cfb11cd6-3b63-4b39-bd80-e0ea13f0bf71 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.524066 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=18 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:44.552052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cfb11cd6-3b63-4b39-bd80-e0ea13f0bf71 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:44.578008 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3dad8553-3986-46dd-9f38-b90b17022512 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:44.579940 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cfb11cd6-3b63-4b39-bd80-e0ea13f0bf71 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 200 len: 1327 microversion: 2.1 time: 0.186063 Aug 24 16:49:44.586391 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 360/713] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:44 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 1327 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:44.596124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3dad8553-3986-46dd-9f38-b90b17022512 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1523 microversion: 2.1 time: 0.492538 Aug 24 16:49:44.603455 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f97ef331-8f2b-4542-bea4-f363bf1dec82 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:44.609018 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f97ef331-8f2b-4542-bea4-f363bf1dec82 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:44.617014 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 354/714] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:44 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1523 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:44.627311 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f97ef331-8f2b-4542-bea4-f363bf1dec82 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.628183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f97ef331-8f2b-4542-bea4-f363bf1dec82 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.628973 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f97ef331-8f2b-4542-bea4-f363bf1dec82 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.643977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f97ef331-8f2b-4542-bea4-f363bf1dec82 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.681765 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f97ef331-8f2b-4542-bea4-f363bf1dec82 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.685495 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f97ef331-8f2b-4542-bea4-f363bf1dec82 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.744377 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:44.805937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-bc5703e0-f034-4f98-b327-abeb73f2b86a req-4b8eaf2d-78e3-49e8-836f-b094c5d226b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a600fdc-214e-48d0-9e23-bcb70134d07a", "tag": "e178d836-24a2-4e3a-8f28-a62c7fb35528"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:44.823768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-bc5703e0-f034-4f98-b327-abeb73f2b86a req-4b8eaf2d-78e3-49e8-836f-b094c5d226b5 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.824655 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-bc5703e0-f034-4f98-b327-abeb73f2b86a req-4b8eaf2d-78e3-49e8-836f-b094c5d226b5 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.825366 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-bc5703e0-f034-4f98-b327-abeb73f2b86a req-4b8eaf2d-78e3-49e8-836f-b094c5d226b5 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.848168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-bc5703e0-f034-4f98-b327-abeb73f2b86a req-4b8eaf2d-78e3-49e8-836f-b094c5d226b5 service nova] Creating event network-changed:e178d836-24a2-4e3a-8f28-a62c7fb35528 for instance 5a600fdc-214e-48d0-9e23-bcb70134d07a on hv-cinder-73116 Aug 24 16:49:44.856676 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-bc5703e0-f034-4f98-b327-abeb73f2b86a req-4b8eaf2d-78e3-49e8-836f-b094c5d226b5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236932 Aug 24 16:49:44.857733 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 355/715] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:44.867264 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-4861f730-b01d-4bd1-9b0e-22d4332aa40e req-edd346b1-a2b9-4a97-9d72-725d8d72a033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75145055-cbf0-4840-b4fc-a2907f7b8f1c", "tag": "2f2e239d-8035-4f37-96dd-4e4f3002af3d"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:44.885220 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-4861f730-b01d-4bd1-9b0e-22d4332aa40e req-edd346b1-a2b9-4a97-9d72-725d8d72a033 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.886349 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-4861f730-b01d-4bd1-9b0e-22d4332aa40e req-edd346b1-a2b9-4a97-9d72-725d8d72a033 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.887483 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-4861f730-b01d-4bd1-9b0e-22d4332aa40e req-edd346b1-a2b9-4a97-9d72-725d8d72a033 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.911135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-4861f730-b01d-4bd1-9b0e-22d4332aa40e req-edd346b1-a2b9-4a97-9d72-725d8d72a033 service nova] Creating event network-changed:2f2e239d-8035-4f37-96dd-4e4f3002af3d for instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c on hv-cinder-73116 Aug 24 16:49:44.920311 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-4861f730-b01d-4bd1-9b0e-22d4332aa40e req-edd346b1-a2b9-4a97-9d72-725d8d72a033 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060170 Aug 24 16:49:44.927352 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 356/716] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:44.942902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-eb8d9f3b-5171-40b7-a906-6db4a159ef2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:44.944625 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-eb8d9f3b-5171-40b7-a906-6db4a159ef2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:44.955707 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb8d9f3b-5171-40b7-a906-6db4a159ef2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.961098 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb8d9f3b-5171-40b7-a906-6db4a159ef2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.961098 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb8d9f3b-5171-40b7-a906-6db4a159ef2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.961098 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb8d9f3b-5171-40b7-a906-6db4a159ef2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.961098 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb8d9f3b-5171-40b7-a906-6db4a159ef2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.962328 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb8d9f3b-5171-40b7-a906-6db4a159ef2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:45.906168 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f97ef331-8f2b-4542-bea4-f363bf1dec82 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:45.920441 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-eb8d9f3b-5171-40b7-a906-6db4a159ef2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:45.922467 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f97ef331-8f2b-4542-bea4-f363bf1dec82 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 1.336574 Aug 24 16:49:45.924830 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=100 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:45.934550 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 361/717] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:44 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:45.938530 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-eb8d9f3b-5171-40b7-a906-6db4a159ef2f tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1364 microversion: 2.1 time: 1.014956 Aug 24 16:49:45.939473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 357/718] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:44 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1364 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:45.947381 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:45.948161 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:45.949600 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:45.950472 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:45.964654 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:45.966295 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:45.967659 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:45.968621 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:45.969249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:45.969835 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:45.981304 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:45.984441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:45.986915 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:45.991640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:45.992963 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:45.996921 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.008940 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 HTTP/1.1 Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:49:46.014647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:49:46.016199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '75981127-7926-42dc-9ab3-1fe58eaf63e2'} Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:46.017102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:49:46.018769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:46.020943 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:46.021818 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3e4b6cc1-59f3-4ad9-b5a3-70d41e5df174 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 404 len: 111 microversion: 2.1 time: 0.081192 Aug 24 16:49:46.022426 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 358/719] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:45 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:46.037849 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d63e792a-3a49-434e-bf6c-05acad9f1504 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:46.042803 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d63e792a-3a49-434e-bf6c-05acad9f1504 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:46.049802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d63e792a-3a49-434e-bf6c-05acad9f1504 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:46.050792 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d63e792a-3a49-434e-bf6c-05acad9f1504 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:46.051649 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d63e792a-3a49-434e-bf6c-05acad9f1504 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.053000 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d63e792a-3a49-434e-bf6c-05acad9f1504 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:46.053856 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d63e792a-3a49-434e-bf6c-05acad9f1504 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:46.054964 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d63e792a-3a49-434e-bf6c-05acad9f1504 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.158638 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d63e792a-3a49-434e-bf6c-05acad9f1504 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:46.178092 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d63e792a-3a49-434e-bf6c-05acad9f1504 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1481 microversion: 2.1 time: 0.149707 Aug 24 16:49:46.179907 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 359/720] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:46 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1481 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:46.189985 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-eadc3cfc-ae01-4ded-919e-caa5cfa7a961 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:46.190935 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-eadc3cfc-ae01-4ded-919e-caa5cfa7a961 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:46.202404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eadc3cfc-ae01-4ded-919e-caa5cfa7a961 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:46.203617 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eadc3cfc-ae01-4ded-919e-caa5cfa7a961 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:46.204446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eadc3cfc-ae01-4ded-919e-caa5cfa7a961 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.206460 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eadc3cfc-ae01-4ded-919e-caa5cfa7a961 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:46.207306 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eadc3cfc-ae01-4ded-919e-caa5cfa7a961 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:46.208076 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eadc3cfc-ae01-4ded-919e-caa5cfa7a961 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.286209 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:46.296658 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:46.299168 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:46.300561 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a20d3a87-8540-453a-804c-148ac873cfb9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1405 microversion: 2.20 time: 0.362192 Aug 24 16:49:46.301468 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 362/721] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:45 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1405 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:46.313120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-179b5bcb-7707-4216-85d8-6452082ede19 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '.version_select at 0x7f06a745dee0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:46.360530 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-eadc3cfc-ae01-4ded-919e-caa5cfa7a961 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lazy-loading 'services' on Instance uuid 5a600fdc-214e-48d0-9e23-bcb70134d07a {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:46.394504 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=10 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:46.414544 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-179b5bcb-7707-4216-85d8-6452082ede19 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210717147" status: 202 len: 0 microversion: 2.1 time: 0.110248 Aug 24 16:49:46.415649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 363/722] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 24 16:49:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210717147 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:49:46.621624 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-eadc3cfc-ae01-4ded-919e-caa5cfa7a961 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments/8167ef3c-de45-476b-a1a1-dc8a38563ac6" status: 202 len: 0 microversion: 2.1 time: 0.438986 Aug 24 16:49:46.623371 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 360/723] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:49:46 2022] DELETE /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments/8167ef3c-de45-476b-a1a1-dc8a38563ac6 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:49:46.650618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-21c1be89-d1ea-4691-ba94-081523197f40 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:46.653289 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-21c1be89-d1ea-4691-ba94-081523197f40 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:46.667130 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21c1be89-d1ea-4691-ba94-081523197f40 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:46.668826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21c1be89-d1ea-4691-ba94-081523197f40 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:46.669736 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21c1be89-d1ea-4691-ba94-081523197f40 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.670759 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21c1be89-d1ea-4691-ba94-081523197f40 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:46.671458 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21c1be89-d1ea-4691-ba94-081523197f40 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:46.672083 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21c1be89-d1ea-4691-ba94-081523197f40 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.741278 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-21c1be89-d1ea-4691-ba94-081523197f40 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107861 Aug 24 16:49:46.747876 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 364/724] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:46 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:46.965117 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-14670c80-33b4-41ac-ab3b-af017c545438 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:46.978645 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3a8bbb6e-54ee-4a78-8b9d-5ad38bcc9ca2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:46.983262 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-14670c80-33b4-41ac-ab3b-af017c545438 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:46.983429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3a8bbb6e-54ee-4a78-8b9d-5ad38bcc9ca2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:47.010643 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a8bbb6e-54ee-4a78-8b9d-5ad38bcc9ca2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.016684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a8bbb6e-54ee-4a78-8b9d-5ad38bcc9ca2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.017740 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14670c80-33b4-41ac-ab3b-af017c545438 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.019327 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a8bbb6e-54ee-4a78-8b9d-5ad38bcc9ca2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.020294 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a8bbb6e-54ee-4a78-8b9d-5ad38bcc9ca2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.021239 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14670c80-33b4-41ac-ab3b-af017c545438 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.023755 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14670c80-33b4-41ac-ab3b-af017c545438 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.024513 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a8bbb6e-54ee-4a78-8b9d-5ad38bcc9ca2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.025812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14670c80-33b4-41ac-ab3b-af017c545438 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.026885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3a8bbb6e-54ee-4a78-8b9d-5ad38bcc9ca2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.033053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14670c80-33b4-41ac-ab3b-af017c545438 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.035894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-14670c80-33b4-41ac-ab3b-af017c545438 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.720182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3a8bbb6e-54ee-4a78-8b9d-5ad38bcc9ca2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:47.732040 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3a8bbb6e-54ee-4a78-8b9d-5ad38bcc9ca2 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1364 microversion: 2.1 time: 0.761327 Aug 24 16:49:47.732875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 365/725] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:46 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1364 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:47.744957 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-14670c80-33b4-41ac-ab3b-af017c545438 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:47.771477 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-14670c80-33b4-41ac-ab3b-af017c545438 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1569 microversion: 2.1 time: 0.820369 Aug 24 16:49:47.776975 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 361/726] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:46 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1569 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:47.781573 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:47.787094 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:47.809633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.811123 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.812325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.813932 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.817515 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.818219 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.875379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-78f1703b-d3ca-427e-8b34-be6d4a7bbd8c req-783039f0-ae31-4a4b-ad32-92643866d30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033273ba-5c67-47d7-8191-7aa0388f87dc", "name": "network-vif-deleted", "tag": "08c8eeee-cfbe-4e3e-9514-c73d861d88db"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:47.894368 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.895618 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.896901 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.899831 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lazy-loading 'fault' on Instance uuid 033273ba-5c67-47d7-8191-7aa0388f87dc {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:47.904371 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-78f1703b-d3ca-427e-8b34-be6d4a7bbd8c req-783039f0-ae31-4a4b-ad32-92643866d30b service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.905405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-78f1703b-d3ca-427e-8b34-be6d4a7bbd8c req-783039f0-ae31-4a4b-ad32-92643866d30b service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.906091 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-78f1703b-d3ca-427e-8b34-be6d4a7bbd8c req-783039f0-ae31-4a4b-ad32-92643866d30b service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.926634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-78f1703b-d3ca-427e-8b34-be6d4a7bbd8c req-783039f0-ae31-4a4b-ad32-92643866d30b service nova] Creating event network-vif-deleted:08c8eeee-cfbe-4e3e-9514-c73d861d88db for instance 033273ba-5c67-47d7-8191-7aa0388f87dc on hv-cinder-73116 Aug 24 16:49:47.932918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-78f1703b-d3ca-427e-8b34-be6d4a7bbd8c req-783039f0-ae31-4a4b-ad32-92643866d30b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198526 Aug 24 16:49:47.935187 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 366/727] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:47.940142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-88fa5766-8be6-4a6e-b174-37434940b0a9 req-8d4593a1-839c-487a-b81b-d7c83379f9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a600fdc-214e-48d0-9e23-bcb70134d07a", "tag": "e178d836-24a2-4e3a-8f28-a62c7fb35528"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:47.956418 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-88fa5766-8be6-4a6e-b174-37434940b0a9 req-8d4593a1-839c-487a-b81b-d7c83379f9a6 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.958664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-88fa5766-8be6-4a6e-b174-37434940b0a9 req-8d4593a1-839c-487a-b81b-d7c83379f9a6 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.959404 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-88fa5766-8be6-4a6e-b174-37434940b0a9 req-8d4593a1-839c-487a-b81b-d7c83379f9a6 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.981505 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-88fa5766-8be6-4a6e-b174-37434940b0a9 req-8d4593a1-839c-487a-b81b-d7c83379f9a6 service nova] Creating event network-changed:e178d836-24a2-4e3a-8f28-a62c7fb35528 for instance 5a600fdc-214e-48d0-9e23-bcb70134d07a on hv-cinder-73116 Aug 24 16:49:47.999875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-88fa5766-8be6-4a6e-b174-37434940b0a9 req-8d4593a1-839c-487a-b81b-d7c83379f9a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062544 Aug 24 16:49:48.002000 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 367/728] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:48.019334 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:48.020045 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:48.029097 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.030307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.031393 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.032672 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.034168 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.051218 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.072222 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be50b041b5947d5909ed6ce516ec8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99d97707cc2485284d8d33522ebb918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:48.098110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8cd2b2f5-abb0-4170-89d2-9713777c39ed tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 200 len: 1312 microversion: 2.1 time: 0.323221 Aug 24 16:49:48.108471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 362/729] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:47 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 1312 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:48.113053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b263b45a-8ab6-4bdc-9a29-f8470babf97b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:48.116490 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b263b45a-8ab6-4bdc-9a29-f8470babf97b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:48.128822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b263b45a-8ab6-4bdc-9a29-f8470babf97b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.134713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b263b45a-8ab6-4bdc-9a29-f8470babf97b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.134713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b263b45a-8ab6-4bdc-9a29-f8470babf97b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.134713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b263b45a-8ab6-4bdc-9a29-f8470babf97b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.134713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b263b45a-8ab6-4bdc-9a29-f8470babf97b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.135210 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b263b45a-8ab6-4bdc-9a29-f8470babf97b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.219095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b263b45a-8ab6-4bdc-9a29-f8470babf97b tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116235 Aug 24 16:49:48.222346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 363/730] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:48 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:48.233326 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-43265013-d166-4ca9-bef6-1d6ae8faba92 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:48.234972 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-43265013-d166-4ca9-bef6-1d6ae8faba92 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:48.251268 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-43265013-d166-4ca9-bef6-1d6ae8faba92 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.257154 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-43265013-d166-4ca9-bef6-1d6ae8faba92 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.258614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-43265013-d166-4ca9-bef6-1d6ae8faba92 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.260851 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-43265013-d166-4ca9-bef6-1d6ae8faba92 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.261956 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-43265013-d166-4ca9-bef6-1d6ae8faba92 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.263192 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-43265013-d166-4ca9-bef6-1d6ae8faba92 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.355377 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-43265013-d166-4ca9-bef6-1d6ae8faba92 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127626) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 16:49:48.558860 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:48.576367 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:48.578542 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:48.581371 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-42f50e90-13d1-4bbe-a7df-ef51bcc0c1af tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1405 microversion: 2.20 time: 0.573739 Aug 24 16:49:48.583441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 368/731] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:48 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1405 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:48.590971 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d8620596-321b-43c9-ade9-c497a211465e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: .version_select at 0x7f06a7464b80>, body: {"keypair": {"name": "tempest-keypair-1769539149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJck+rrT+HTkPynqLKp6YxII65NB3poygLS0Pw6JZmEIUjPo8h5Z5sREt8cpgOC7C8zF9akUvE9RcfRfD8lCUFNMszlHUxIzBJF/sPedPG0Y63UXUQ6EVrI1p9IAemY78g=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:48.609836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:48.618338 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-d8620596-321b-43c9-ade9-c497a211465e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:49:48.623665 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-d8620596-321b-43c9-ade9-c497a211465e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for user 1d9f7755863d45bfb04a1498bd62e367 and project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:49:48.727081 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d8620596-321b-43c9-ade9-c497a211465e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143498 Aug 24 16:49:48.727902 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 369/732] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 16:49:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:48.773641 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ac2dc1cb-9c14-4549-ac41-535d6f00f569 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:48.778555 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ac2dc1cb-9c14-4549-ac41-535d6f00f569 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:48.782018 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac2dc1cb-9c14-4549-ac41-535d6f00f569 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.782522 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac2dc1cb-9c14-4549-ac41-535d6f00f569 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.783492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac2dc1cb-9c14-4549-ac41-535d6f00f569 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.784268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac2dc1cb-9c14-4549-ac41-535d6f00f569 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.784747 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac2dc1cb-9c14-4549-ac41-535d6f00f569 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.785182 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac2dc1cb-9c14-4549-ac41-535d6f00f569 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.843925 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-43265013-d166-4ca9-bef6-1d6ae8faba92 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "POST /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d/action" status: 202 len: 0 microversion: 2.1 time: 0.618744 Aug 24 16:49:48.851620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 364/733] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 16:49:48 2022] POST /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:49:48.863589 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-21ba624f-f6ac-4774-a86d-c41e7d8a7d02 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:48.864916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-21ba624f-f6ac-4774-a86d-c41e7d8a7d02 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:48.875698 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba624f-f6ac-4774-a86d-c41e7d8a7d02 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.876470 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba624f-f6ac-4774-a86d-c41e7d8a7d02 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.878745 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba624f-f6ac-4774-a86d-c41e7d8a7d02 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.879822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba624f-f6ac-4774-a86d-c41e7d8a7d02 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.880989 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba624f-f6ac-4774-a86d-c41e7d8a7d02 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.882172 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-21ba624f-f6ac-4774-a86d-c41e7d8a7d02 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.156179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ac2dc1cb-9c14-4549-ac41-535d6f00f569 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:49.193697 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ac2dc1cb-9c14-4549-ac41-535d6f00f569 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1364 microversion: 2.1 time: 0.424673 Aug 24 16:49:49.195338 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 370/734] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:48 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1364 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:49.205244 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:49.206224 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] [instance: 033273ba-5c67-47d7-8191-7aa0388f87dc] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:49.217264 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.222594 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.223601 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.226418 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.227503 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.228718 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.284218 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] HTTP exception thrown: Instance 033273ba-5c67-47d7-8191-7aa0388f87dc could not be found. Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Request method failure captured: Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc HTTP/1.1 Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVrq4otjVfNs1uNhZq-g4sAERo3MCXWw2NQYHqborGd7Oaii9xLab3Pt0-8QlH74mIPv8kZJIE-LFWi6PcEjKsGX7UHEsOkoz3dyJSNGRmFq6On_8oypwQPm4-AgYkuvsGAxniLTuRpvFguDpbYuah9Oi7vrOEdpyuVVMqsr3ehiJM Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: c99d97707cc2485284d8d33522ebb918 Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:49:49.288122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c99d97707cc2485284d8d33522ebb918", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c99d97707cc2485284d8d33522ebb918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: c99d97707cc2485284d8d33522ebb918 Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1231782798 Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-ServerRescueNegativeTestJSON-1231782798-project Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 7be50b041b5947d5909ed6ce516ec8bf Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1231782798-project Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 033273ba-5c67-47d7-8191-7aa0388f87dc could not be found. Aug 24 16:49:49.290369 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '033273ba-5c67-47d7-8191-7aa0388f87dc'} Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033273ba-5c67-47d7-8191-7aa0388f87dc could not be found. Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:49.291638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033273ba-5c67-47d7-8191-7aa0388f87dc could not be found. Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033273ba-5c67-47d7-8191-7aa0388f87dc could not be found. Aug 24 16:49:49.295694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:49.298532 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] Returning 404 to user: Instance 033273ba-5c67-47d7-8191-7aa0388f87dc could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:49.302700 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d182341d-f208-41ec-96c6-658675aff731 tempest-ServerRescueNegativeTestJSON-1231782798 tempest-ServerRescueNegativeTestJSON-1231782798-project] 10.222.0.17 "GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc" status: 404 len: 111 microversion: 2.1 time: 0.096663 Aug 24 16:49:49.304437 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 371/735] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:49 2022] GET /compute/v2.1/servers/033273ba-5c67-47d7-8191-7aa0388f87dc => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:49.328567 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-82a8fdda-c3d3-409a-bbd0-3cdb725c1127 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:49.335558 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-82a8fdda-c3d3-409a-bbd0-3cdb725c1127 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:49.350729 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82a8fdda-c3d3-409a-bbd0-3cdb725c1127 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.352124 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82a8fdda-c3d3-409a-bbd0-3cdb725c1127 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.352364 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82a8fdda-c3d3-409a-bbd0-3cdb725c1127 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.354897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82a8fdda-c3d3-409a-bbd0-3cdb725c1127 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.355215 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82a8fdda-c3d3-409a-bbd0-3cdb725c1127 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.357044 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82a8fdda-c3d3-409a-bbd0-3cdb725c1127 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.387980 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-21ba624f-f6ac-4774-a86d-c41e7d8a7d02 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:49.418096 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-21ba624f-f6ac-4774-a86d-c41e7d8a7d02 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1517 microversion: 2.1 time: 0.564148 Aug 24 16:49:49.420948 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 365/736] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:48 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1517 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:49.453574 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-82a8fdda-c3d3-409a-bbd0-3cdb725c1127 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.139935 Aug 24 16:49:49.459362 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 372/737] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:49 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments => generated 25 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:49:49.475240 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:49.475900 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:49.490047 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.491011 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.491549 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.492881 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.494296 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.494934 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.619774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:49.620934 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:49.629069 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.632453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.634057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.636671 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.640994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.642245 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.688651 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:49.691375 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] HTTP exception thrown: Instance 5a600fdc-214e-48d0-9e23-bcb70134d07a is not attached to volume 8167ef3c-de45-476b-a1a1-dc8a38563ac6 Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Request method failure captured: Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: DELETE /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments/8167ef3c-de45-476b-a1a1-dc8a38563ac6 HTTP/1.1 Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlYDb052HCIdNdJ0BzACF63dzpGi6VhlL_kOVva9cBSVQ-pmonbBTQmRMgFN_8w7eBIeAebtAlsk_KVRwlFDyEFAD0L6Jbib4VNbe9_6atki3AFCGOf-YsMa6TD6_cHI5hgaF_WNLWojdiDx1Ywe2WipEYzGX5KAKR0WhpXkFC4YH2k Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 09e2ab2c313d4448a28a6902b74a0d10 Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-TestMinimumBasicScenario-930773383 Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:49:49.699947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:49:49.703102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/09e2ab2c313d4448a28a6902b74a0d10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/09e2ab2c313d4448a28a6902b74a0d10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_09e2ab2c313d4448a28a6902b74a0d10", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/09e2ab2c313d4448a28a6902b74a0d10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:49:49.703102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-TestMinimumBasicScenario-930773383 Aug 24 16:49:49.703102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 09e2ab2c313d4448a28a6902b74a0d10 Aug 24 16:49:49.703102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-TestMinimumBasicScenario-930773383 Aug 24 16:49:49.703102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-TestMinimumBasicScenario-930773383-project Aug 24 16:49:49.703102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:49:49.703102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:49:49.703102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 680f726c9e374d97aff5ebe924c84865 Aug 24 16:49:49.703102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-TestMinimumBasicScenario-930773383-project Aug 24 16:49:49.703102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:49:49.703102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 5a600fdc-214e-48d0-9e23-bcb70134d07a is not attached to volume 8167ef3c-de45-476b-a1a1-dc8a38563ac6 Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'server_id': '5a600fdc-214e-48d0-9e23-bcb70134d07a', 'id': '8167ef3c-de45-476b-a1a1-dc8a38563ac6'} Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8167ef3c-de45-476b-a1a1-dc8a38563ac6. Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:49.704808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a600fdc-214e-48d0-9e23-bcb70134d07a is not attached to volume 8167ef3c-de45-476b-a1a1-dc8a38563ac6 Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a600fdc-214e-48d0-9e23-bcb70134d07a is not attached to volume 8167ef3c-de45-476b-a1a1-dc8a38563ac6 Aug 24 16:49:49.707280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:49:49.710233 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Returning 404 to user: Instance 5a600fdc-214e-48d0-9e23-bcb70134d07a is not attached to volume 8167ef3c-de45-476b-a1a1-dc8a38563ac6 {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:49.711387 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-91e57e0a-3223-4ca1-b73d-7ff947c5e701 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments/8167ef3c-de45-476b-a1a1-dc8a38563ac6" status: 404 len: 154 microversion: 2.1 time: 0.240811 Aug 24 16:49:49.717711 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 366/738] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:49:49 2022] DELETE /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a/os-volume_attachments/8167ef3c-de45-476b-a1a1-dc8a38563ac6 => generated 154 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:49.763225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-40abd323-84de-4bef-9c3b-004b62f8884a req-dea385f9-2e13-4e20-8c8e-89853abe9f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4ea3cd-ed8d-4169-8be6-716b693de76d", "name": "network-vif-unplugged", "status": "completed", "tag": "a3e2b5de-778c-4f0f-bb74-761971b6f904"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:49.787556 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-40abd323-84de-4bef-9c3b-004b62f8884a req-dea385f9-2e13-4e20-8c8e-89853abe9f6d service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.788552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-40abd323-84de-4bef-9c3b-004b62f8884a req-dea385f9-2e13-4e20-8c8e-89853abe9f6d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.789555 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-40abd323-84de-4bef-9c3b-004b62f8884a req-dea385f9-2e13-4e20-8c8e-89853abe9f6d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.811410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.compute.server_external_events [req-40abd323-84de-4bef-9c3b-004b62f8884a req-dea385f9-2e13-4e20-8c8e-89853abe9f6d service nova] Unable to find a host for instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d. Dropping event network-vif-unplugged {{(pid=127626) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 16:49:49.815057 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-40abd323-84de-4bef-9c3b-004b62f8884a req-dea385f9-2e13-4e20-8c8e-89853abe9f6d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.057644 Aug 24 16:49:49.815057 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 367/739] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 16:49:50.193436 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:50.213814 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:50.217621 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:50.231805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6bc379e5-5298-4f3b-ba66-6684003b5391 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:50.232922 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6bc379e5-5298-4f3b-ba66-6684003b5391 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:50.238703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bd68b1bc-cdd5-45eb-b43f-208598541dbc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1405 microversion: 2.20 time: 0.621925 Aug 24 16:49:50.248417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 373/740] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:49 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1405 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:50.254293 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6bc379e5-5298-4f3b-ba66-6684003b5391 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:50.257958 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6bc379e5-5298-4f3b-ba66-6684003b5391 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:50.259583 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6bc379e5-5298-4f3b-ba66-6684003b5391 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:50.260463 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6bc379e5-5298-4f3b-ba66-6684003b5391 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:50.261268 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6bc379e5-5298-4f3b-ba66-6684003b5391 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:50.261908 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6bc379e5-5298-4f3b-ba66-6684003b5391 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:50.451229 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a03b2be9-845a-44de-a194-77a38d5552ac tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:50.452668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a03b2be9-845a-44de-a194-77a38d5552ac tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:50.463713 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a03b2be9-845a-44de-a194-77a38d5552ac tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:50.464754 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a03b2be9-845a-44de-a194-77a38d5552ac tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:50.465446 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a03b2be9-845a-44de-a194-77a38d5552ac tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:50.465700 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-6bc379e5-5298-4f3b-ba66-6684003b5391 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:50.467328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a03b2be9-845a-44de-a194-77a38d5552ac tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:50.468500 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a03b2be9-845a-44de-a194-77a38d5552ac tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:50.469138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a03b2be9-845a-44de-a194-77a38d5552ac tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:50.479808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6bc379e5-5298-4f3b-ba66-6684003b5391 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1364 microversion: 2.1 time: 0.249783 Aug 24 16:49:50.480806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 368/741] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:50 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:50.741177 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a03b2be9-845a-44de-a194-77a38d5552ac tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:50.758771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a03b2be9-845a-44de-a194-77a38d5552ac tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1519 microversion: 2.1 time: 0.314073 Aug 24 16:49:50.759815 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 374/742] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:50 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1519 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:51.195964 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6c337d7b-2488-4988-ae0e-3c0a40b8e212 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:51.197862 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6c337d7b-2488-4988-ae0e-3c0a40b8e212 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:51.213095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6c337d7b-2488-4988-ae0e-3c0a40b8e212 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:51.216463 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6c337d7b-2488-4988-ae0e-3c0a40b8e212 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:51.216463 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6c337d7b-2488-4988-ae0e-3c0a40b8e212 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:51.216463 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6c337d7b-2488-4988-ae0e-3c0a40b8e212 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:51.217665 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6c337d7b-2488-4988-ae0e-3c0a40b8e212 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:51.218692 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6c337d7b-2488-4988-ae0e-3c0a40b8e212 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:51.272214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:51.276752 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6c337d7b-2488-4988-ae0e-3c0a40b8e212 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Going to try to terminate instance {{(pid=127626) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:49:51.276971 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:51.286866 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:51.287633 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:51.288254 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:51.289812 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:51.291098 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:51.291700 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:51.704063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:51.732138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:51.739705 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:51.742136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f075a272-d0b0-4ee9-b92b-2f128244abe8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1405 microversion: 2.20 time: 0.481619 Aug 24 16:49:51.748457 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 375/743] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:51 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:51.752826 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6c337d7b-2488-4988-ae0e-3c0a40b8e212 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 204 len: 0 microversion: 2.1 time: 0.561768 Aug 24 16:49:51.757032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d149bd53-b9bf-4a27-be62-5c5423809184 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:51.758379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d149bd53-b9bf-4a27-be62-5c5423809184 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:51.759193 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 369/744] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:49:51 2022] DELETE /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:51.779783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d149bd53-b9bf-4a27-be62-5c5423809184 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:51.782835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d149bd53-b9bf-4a27-be62-5c5423809184 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:51.784288 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d149bd53-b9bf-4a27-be62-5c5423809184 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:51.788173 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d149bd53-b9bf-4a27-be62-5c5423809184 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:51.788849 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d149bd53-b9bf-4a27-be62-5c5423809184 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:51.788998 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d149bd53-b9bf-4a27-be62-5c5423809184 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:51.793822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-48ee5c93-b230-4eb7-b6da-83f8ac8f021c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:51.794553 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-48ee5c93-b230-4eb7-b6da-83f8ac8f021c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:51.813125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48ee5c93-b230-4eb7-b6da-83f8ac8f021c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:51.815203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48ee5c93-b230-4eb7-b6da-83f8ac8f021c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:51.817530 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48ee5c93-b230-4eb7-b6da-83f8ac8f021c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:51.822971 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48ee5c93-b230-4eb7-b6da-83f8ac8f021c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:51.824474 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48ee5c93-b230-4eb7-b6da-83f8ac8f021c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:51.848169 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-48ee5c93-b230-4eb7-b6da-83f8ac8f021c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:52.569187 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d149bd53-b9bf-4a27-be62-5c5423809184 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:52.593059 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d149bd53-b9bf-4a27-be62-5c5423809184 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1364 microversion: 2.1 time: 0.847302 Aug 24 16:49:52.613652 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 376/745] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:51 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1364 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:52.623520 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-48ee5c93-b230-4eb7-b6da-83f8ac8f021c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:52.630501 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-78592431-f594-4cdf-983e-2d0873561673 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:52.631957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-78592431-f594-4cdf-983e-2d0873561673 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:52.645261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-78592431-f594-4cdf-983e-2d0873561673 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:52.646513 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-78592431-f594-4cdf-983e-2d0873561673 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:52.647673 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-78592431-f594-4cdf-983e-2d0873561673 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:52.649323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-78592431-f594-4cdf-983e-2d0873561673 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:52.650382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-78592431-f594-4cdf-983e-2d0873561673 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:52.651401 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-78592431-f594-4cdf-983e-2d0873561673 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:52.671350 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-48ee5c93-b230-4eb7-b6da-83f8ac8f021c tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1555 microversion: 2.1 time: 0.878979 Aug 24 16:49:52.671350 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 370/746] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:51 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1555 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:52.678626 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-1f100f89-9a1a-4e9f-b88b-8d32950fefe9 req-b08733e4-261e-44e4-b5a1-11cb71fca941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75145055-cbf0-4840-b4fc-a2907f7b8f1c", "name": "network-vif-plugged", "status": "completed", "tag": "2f2e239d-8035-4f37-96dd-4e4f3002af3d"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:52.690252 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-1f100f89-9a1a-4e9f-b88b-8d32950fefe9 req-b08733e4-261e-44e4-b5a1-11cb71fca941 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:52.695462 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-1f100f89-9a1a-4e9f-b88b-8d32950fefe9 req-b08733e4-261e-44e4-b5a1-11cb71fca941 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:52.696622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-1f100f89-9a1a-4e9f-b88b-8d32950fefe9 req-b08733e4-261e-44e4-b5a1-11cb71fca941 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:52.743298 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-1f100f89-9a1a-4e9f-b88b-8d32950fefe9 req-b08733e4-261e-44e4-b5a1-11cb71fca941 service nova] Creating event network-vif-plugged:2f2e239d-8035-4f37-96dd-4e4f3002af3d for instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c on hv-cinder-73116 Aug 24 16:49:52.750548 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-1f100f89-9a1a-4e9f-b88b-8d32950fefe9 req-b08733e4-261e-44e4-b5a1-11cb71fca941 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086935 Aug 24 16:49:52.752430 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 371/747] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:52.785451 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:52.788531 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:52.797864 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:52.799240 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:52.800245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:52.801860 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:52.803610 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:52.804981 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:53.093013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-78592431-f594-4cdf-983e-2d0873561673 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:53.119506 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-78592431-f594-4cdf-983e-2d0873561673 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1519 microversion: 2.1 time: 0.502145 Aug 24 16:49:53.124995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 377/748] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:52 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1519 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:53.198719 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:53.203869 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:53.215185 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:53.216965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:53.218731 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-279c8688-4dda-4a51-a9d7-a54c4eda5334 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1405 microversion: 2.20 time: 0.441646 Aug 24 16:49:53.220800 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 372/749] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:52 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:53.633325 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-719ee292-eb3e-4a87-a858-e73016ff29ab tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:53.634626 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-719ee292-eb3e-4a87-a858-e73016ff29ab tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:53.641781 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-719ee292-eb3e-4a87-a858-e73016ff29ab tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:53.643102 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-719ee292-eb3e-4a87-a858-e73016ff29ab tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:53.644063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-719ee292-eb3e-4a87-a858-e73016ff29ab tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:53.645122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-719ee292-eb3e-4a87-a858-e73016ff29ab tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:53.645853 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-719ee292-eb3e-4a87-a858-e73016ff29ab tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:53.646518 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-719ee292-eb3e-4a87-a858-e73016ff29ab tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:53.702585 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-89497ee2-f51c-4cd0-a5c8-c0d9cc4f4959 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:53.703985 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-89497ee2-f51c-4cd0-a5c8-c0d9cc4f4959 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:53.712551 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:53.718523 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-89497ee2-f51c-4cd0-a5c8-c0d9cc4f4959 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:53.719492 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-89497ee2-f51c-4cd0-a5c8-c0d9cc4f4959 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:53.720151 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-89497ee2-f51c-4cd0-a5c8-c0d9cc4f4959 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:53.721192 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-89497ee2-f51c-4cd0-a5c8-c0d9cc4f4959 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:53.721865 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-89497ee2-f51c-4cd0-a5c8-c0d9cc4f4959 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:53.722489 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-89497ee2-f51c-4cd0-a5c8-c0d9cc4f4959 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:54.153760 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-719ee292-eb3e-4a87-a858-e73016ff29ab tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:54.169127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-719ee292-eb3e-4a87-a858-e73016ff29ab tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1364 microversion: 2.1 time: 0.539298 Aug 24 16:49:54.170454 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 378/750] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:53 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1364 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:54.175815 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-89497ee2-f51c-4cd0-a5c8-c0d9cc4f4959 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:54.192382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-781845424", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "883b1cf6-8114-4681-9877-f2163f4c86c7"}], "security_groups": [{"name": "tempest-securitygroup--1791498502"}], "key_name": "tempest-keypair-1769539149", "user_data": "}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:54.197113 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-89497ee2-f51c-4cd0-a5c8-c0d9cc4f4959 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1555 microversion: 2.1 time: 0.501313 Aug 24 16:49:54.213489 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 373/751] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:53 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1555 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:54.236403 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-58eca67b-d9aa-4077-ad3f-3e75af1c6385 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:54.237561 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-58eca67b-d9aa-4077-ad3f-3e75af1c6385 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:54.246648 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58eca67b-d9aa-4077-ad3f-3e75af1c6385 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:54.247140 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58eca67b-d9aa-4077-ad3f-3e75af1c6385 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:54.247649 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58eca67b-d9aa-4077-ad3f-3e75af1c6385 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:54.248374 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58eca67b-d9aa-4077-ad3f-3e75af1c6385 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:54.248914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58eca67b-d9aa-4077-ad3f-3e75af1c6385 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:54.249341 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58eca67b-d9aa-4077-ad3f-3e75af1c6385 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:54.553295 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] validate_networks() for [('883b1cf6-8114-4681-9877-f2163f4c86c7', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:49:54.654628 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-58eca67b-d9aa-4077-ad3f-3e75af1c6385 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:54.667896 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-58eca67b-d9aa-4077-ad3f-3e75af1c6385 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.451487 Aug 24 16:49:54.670078 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 374/752] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:54 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:54.675365 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:54.676057 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:54.686907 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:54.687704 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:54.688315 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:54.689332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:54.689935 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:54.690777 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:55.198916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:55.232225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:55.235653 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:55.247215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b6090ec5-2b41-4060-b357-541b00e00705 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1405 microversion: 2.20 time: 0.569605 Aug 24 16:49:55.248472 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 375/753] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:54 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1405 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:55.261029 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-de983281-0fb4-460b-84db-3aeba944b15d req-c453ca0b-e324-4c7c-af54-55b2313f774e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b9c747-048e-4478-b065-0bd606ea331a", "name": "network-vif-plugged", "status": "completed", "tag": "01448d18-9692-445d-a2e1-37cc9a89b059"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:55.281399 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-de983281-0fb4-460b-84db-3aeba944b15d req-c453ca0b-e324-4c7c-af54-55b2313f774e service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:55.282306 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-de983281-0fb4-460b-84db-3aeba944b15d req-c453ca0b-e324-4c7c-af54-55b2313f774e service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:55.283001 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-de983281-0fb4-460b-84db-3aeba944b15d req-c453ca0b-e324-4c7c-af54-55b2313f774e service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:55.303810 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-de983281-0fb4-460b-84db-3aeba944b15d req-c453ca0b-e324-4c7c-af54-55b2313f774e service nova] Creating event network-vif-plugged:01448d18-9692-445d-a2e1-37cc9a89b059 for instance 09b9c747-048e-4478-b065-0bd606ea331a on hv-cinder-73116 Aug 24 16:49:55.311444 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-de983281-0fb4-460b-84db-3aeba944b15d req-c453ca0b-e324-4c7c-af54-55b2313f774e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060910 Aug 24 16:49:55.312947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 376/754] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:55.320965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f8d85aa9-50df-4272-b7f7-feec441c3679 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:55.322172 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f8d85aa9-50df-4272-b7f7-feec441c3679 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:55.334869 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f8d85aa9-50df-4272-b7f7-feec441c3679 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:55.341454 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f8d85aa9-50df-4272-b7f7-feec441c3679 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:55.341454 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f8d85aa9-50df-4272-b7f7-feec441c3679 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:55.341454 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f8d85aa9-50df-4272-b7f7-feec441c3679 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:55.341454 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f8d85aa9-50df-4272-b7f7-feec441c3679 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:55.341789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f8d85aa9-50df-4272-b7f7-feec441c3679 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:55.840692 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f8d85aa9-50df-4272-b7f7-feec441c3679 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:55.857475 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f8d85aa9-50df-4272-b7f7-feec441c3679 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1364 microversion: 2.1 time: 0.541938 Aug 24 16:49:55.858716 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 377/755] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:55 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1364 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:55.866261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:49:55.868062 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:49:55.869398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:49:55.870791 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:49:55.875574 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:49:55.882136 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:55.882136 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:55.887185 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:55.888152 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:55.889325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:55.890458 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:55.891240 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:55.891910 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:55.933417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:55.933417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:55.937867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:55.943193 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:55.944216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:55.945792 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:55.978397 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:49:55.983676 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Getting quotas for user 1d9f7755863d45bfb04a1498bd62e367 and project 8af535d51fd345f8a9584cc6aaa38bda. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:49:56.000917 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.001446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.007654 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.008143 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lazy-loading 'fault' on Instance uuid 5a600fdc-214e-48d0-9e23-bcb70134d07a {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:56.030540 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:49:56.034589 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:49:56.116816 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f726c9e374d97aff5ebe924c84865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e2ab2c313d4448a28a6902b74a0d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:56.142496 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-58f5bbbe-0c31-4bef-8f13-d005fb45cc64 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 200 len: 1348 microversion: 2.1 time: 0.282047 Aug 24 16:49:56.144805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 378/756] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:55 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 1348 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:56.157014 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-268a670e-2829-44ac-bb25-d3a2178c795e req-00b787ab-69fa-4227-9fec-5ad14e4121da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a600fdc-214e-48d0-9e23-bcb70134d07a", "name": "network-vif-deleted", "tag": "e178d836-24a2-4e3a-8f28-a62c7fb35528"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:56.181253 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-268a670e-2829-44ac-bb25-d3a2178c795e req-00b787ab-69fa-4227-9fec-5ad14e4121da service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.184829 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-268a670e-2829-44ac-bb25-d3a2178c795e req-00b787ab-69fa-4227-9fec-5ad14e4121da service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.184829 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-268a670e-2829-44ac-bb25-d3a2178c795e req-00b787ab-69fa-4227-9fec-5ad14e4121da service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.208188 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-268a670e-2829-44ac-bb25-d3a2178c795e req-00b787ab-69fa-4227-9fec-5ad14e4121da service nova] Creating event network-vif-deleted:e178d836-24a2-4e3a-8f28-a62c7fb35528 for instance 5a600fdc-214e-48d0-9e23-bcb70134d07a on hv-cinder-73116 Aug 24 16:49:56.223066 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-268a670e-2829-44ac-bb25-d3a2178c795e req-00b787ab-69fa-4227-9fec-5ad14e4121da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072898 Aug 24 16:49:56.223444 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 379/757] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:56.229819 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-38a1a1c6-eab6-474b-9a05-c16d0685f7bd tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:56.230688 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-38a1a1c6-eab6-474b-9a05-c16d0685f7bd tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:56.238131 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38a1a1c6-eab6-474b-9a05-c16d0685f7bd tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.238590 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38a1a1c6-eab6-474b-9a05-c16d0685f7bd tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.239015 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38a1a1c6-eab6-474b-9a05-c16d0685f7bd tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.242037 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38a1a1c6-eab6-474b-9a05-c16d0685f7bd tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.242037 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38a1a1c6-eab6-474b-9a05-c16d0685f7bd tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.242037 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-38a1a1c6-eab6-474b-9a05-c16d0685f7bd tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.315583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2262b415-3799-4621-b415-4b8fdb9a6e7e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.140459 Aug 24 16:49:56.317628 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 379/758] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:49:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:49:56.339693 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:56.340492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:56.369903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.370888 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.371563 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.381440 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.382048 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.382496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.616491 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-38a1a1c6-eab6-474b-9a05-c16d0685f7bd tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:56.629077 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-38a1a1c6-eab6-474b-9a05-c16d0685f7bd tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.403714 Aug 24 16:49:56.630766 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 380/759] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:56 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:56.639933 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f0249743-8eb9-47f7-9ba7-dfd21bc4f36e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:56.641551 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f0249743-8eb9-47f7-9ba7-dfd21bc4f36e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:56.677893 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:56.685847 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:56.689468 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:56.692303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-08cee19d-e049-43bb-ac85-e34a163cfae3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1596 microversion: 2.20 time: 0.370620 Aug 24 16:49:56.693487 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 380/760] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:56 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1596 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:56.716888 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d2918515-dad7-4aa9-a017-55ce8fdb7d6b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:56.717666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d2918515-dad7-4aa9-a017-55ce8fdb7d6b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:56.726203 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2918515-dad7-4aa9-a017-55ce8fdb7d6b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.727165 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2918515-dad7-4aa9-a017-55ce8fdb7d6b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.727818 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2918515-dad7-4aa9-a017-55ce8fdb7d6b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.731078 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f0249743-8eb9-47f7-9ba7-dfd21bc4f36e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:56.735407 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2918515-dad7-4aa9-a017-55ce8fdb7d6b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.735407 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2918515-dad7-4aa9-a017-55ce8fdb7d6b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.735407 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2918515-dad7-4aa9-a017-55ce8fdb7d6b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.739767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f0249743-8eb9-47f7-9ba7-dfd21bc4f36e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1241 microversion: 2.1 time: 0.107784 Aug 24 16:49:56.740392 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 381/761] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:56 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:56.841619 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d2918515-dad7-4aa9-a017-55ce8fdb7d6b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128619 Aug 24 16:49:56.842258 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 381/762] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Aug 24 16:49:56 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:49:56.890092 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-96d46295-29a6-4285-9b0d-78320d8b911d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:56.890704 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-96d46295-29a6-4285-9b0d-78320d8b911d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:56.901135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96d46295-29a6-4285-9b0d-78320d8b911d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.902304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96d46295-29a6-4285-9b0d-78320d8b911d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.903500 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96d46295-29a6-4285-9b0d-78320d8b911d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.905277 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96d46295-29a6-4285-9b0d-78320d8b911d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.906353 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96d46295-29a6-4285-9b0d-78320d8b911d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.907017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96d46295-29a6-4285-9b0d-78320d8b911d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:57.141815 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-96d46295-29a6-4285-9b0d-78320d8b911d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:57.152672 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-96d46295-29a6-4285-9b0d-78320d8b911d tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1364 microversion: 2.1 time: 0.266166 Aug 24 16:49:57.153365 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 382/763] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:56 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:57.175081 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:57.175687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] [instance: 5a600fdc-214e-48d0-9e23-bcb70134d07a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:57.182402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:57.182904 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:57.183378 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:57.184078 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:57.184565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:57.184986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:57.203513 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] HTTP exception thrown: Instance 5a600fdc-214e-48d0-9e23-bcb70134d07a could not be found. Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Request method failure captured: Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a HTTP/1.1 Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlYDb052HCIdNdJ0BzACF63dzpGi6VhlL_kOVva9cBSVQ-pmonbBTQmRMgFN_8w7eBIeAebtAlsk_KVRwlFDyEFAD0L6Jbib4VNbe9_6atki3AFCGOf-YsMa6TD6_cHI5hgaF_WNLWojdiDx1Ywe2WipEYzGX5KAKR0WhpXkFC4YH2k Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 09e2ab2c313d4448a28a6902b74a0d10 Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-TestMinimumBasicScenario-930773383 Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:49:57.205140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/09e2ab2c313d4448a28a6902b74a0d10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/09e2ab2c313d4448a28a6902b74a0d10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_09e2ab2c313d4448a28a6902b74a0d10", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/09e2ab2c313d4448a28a6902b74a0d10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-TestMinimumBasicScenario-930773383 Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 09e2ab2c313d4448a28a6902b74a0d10 Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-TestMinimumBasicScenario-930773383 Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-TestMinimumBasicScenario-930773383-project Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 680f726c9e374d97aff5ebe924c84865 Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-TestMinimumBasicScenario-930773383-project Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 5a600fdc-214e-48d0-9e23-bcb70134d07a could not be found. Aug 24 16:49:57.212284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '5a600fdc-214e-48d0-9e23-bcb70134d07a'} Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a600fdc-214e-48d0-9e23-bcb70134d07a could not be found. Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:57.213402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a600fdc-214e-48d0-9e23-bcb70134d07a could not be found. Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a600fdc-214e-48d0-9e23-bcb70134d07a could not be found. Aug 24 16:49:57.214875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:49:57.216328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Returning 404 to user: Instance 5a600fdc-214e-48d0-9e23-bcb70134d07a could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:57.216328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-551434ae-641d-4f6f-ba21-9fadef133d93 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a" status: 404 len: 111 microversion: 2.1 time: 0.036766 Aug 24 16:49:57.216328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 382/764] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:57 2022] GET /compute/v2.1/servers/5a600fdc-214e-48d0-9e23-bcb70134d07a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:57.224753 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f378750d-5e24-44c0-93af-def4b68aed02 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] Calling method '.version_select at 0x7f06a6ea9a60>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:57.444621 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f378750d-5e24-44c0-93af-def4b68aed02 tempest-TestMinimumBasicScenario-930773383 tempest-TestMinimumBasicScenario-930773383-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-587603887" status: 202 len: 0 microversion: 2.1 time: 0.226195 Aug 24 16:49:57.445761 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 383/765] 10.222.0.17 () {58 vars in 1269 bytes} [Wed Aug 24 16:49:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-587603887 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:49:57.667357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4ed32e4f-9074-4492-8f38-323cc59ad03a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:57.668520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4ed32e4f-9074-4492-8f38-323cc59ad03a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:57.700379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ed32e4f-9074-4492-8f38-323cc59ad03a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:57.703247 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ed32e4f-9074-4492-8f38-323cc59ad03a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:57.704188 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ed32e4f-9074-4492-8f38-323cc59ad03a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:57.706061 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ed32e4f-9074-4492-8f38-323cc59ad03a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:57.708640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ed32e4f-9074-4492-8f38-323cc59ad03a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:57.709544 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ed32e4f-9074-4492-8f38-323cc59ad03a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:57.772617 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e83a5dff-df4b-4a8c-91f6-cd0ea180f537 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:57.772945 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e83a5dff-df4b-4a8c-91f6-cd0ea180f537 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:57.873620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e83a5dff-df4b-4a8c-91f6-cd0ea180f537 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:57.886316 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e83a5dff-df4b-4a8c-91f6-cd0ea180f537 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1241 microversion: 2.1 time: 0.127754 Aug 24 16:49:57.901149 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 384/766] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:57 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1241 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:57.975655 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4ed32e4f-9074-4492-8f38-323cc59ad03a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:57.991308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4ed32e4f-9074-4492-8f38-323cc59ad03a tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.334107 Aug 24 16:49:58.017367 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 383/767] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:57 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:58.177680 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-41df8544-ab9c-4db2-a216-1af93095edc5 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:58.178805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-41df8544-ab9c-4db2-a216-1af93095edc5 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:58.200446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41df8544-ab9c-4db2-a216-1af93095edc5 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.201300 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41df8544-ab9c-4db2-a216-1af93095edc5 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.201751 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41df8544-ab9c-4db2-a216-1af93095edc5 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.202467 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41df8544-ab9c-4db2-a216-1af93095edc5 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.202934 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41df8544-ab9c-4db2-a216-1af93095edc5 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.203355 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-41df8544-ab9c-4db2-a216-1af93095edc5 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.391629 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-41df8544-ab9c-4db2-a216-1af93095edc5 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:58.408374 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-41df8544-ab9c-4db2-a216-1af93095edc5 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1550 microversion: 2.1 time: 0.236084 Aug 24 16:49:58.425438 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 385/768] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:58 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1550 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:58.431692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d4972aa8-c6cd-46aa-9e44-cdacd1fbdea6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:58.432261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d4972aa8-c6cd-46aa-9e44-cdacd1fbdea6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:58.439578 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d4972aa8-c6cd-46aa-9e44-cdacd1fbdea6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.440139 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d4972aa8-c6cd-46aa-9e44-cdacd1fbdea6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.440623 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d4972aa8-c6cd-46aa-9e44-cdacd1fbdea6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.441425 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d4972aa8-c6cd-46aa-9e44-cdacd1fbdea6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.441880 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d4972aa8-c6cd-46aa-9e44-cdacd1fbdea6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.442510 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d4972aa8-c6cd-46aa-9e44-cdacd1fbdea6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.574228 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d4972aa8-c6cd-46aa-9e44-cdacd1fbdea6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147660 Aug 24 16:49:58.574912 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 384/769] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 16:49:58 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:58.651019 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-dc97f7d6-2c39-42d5-91a2-53bb6804fe15 req-d0f75493-3a4e-4fac-8ebb-833e69587a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75145055-cbf0-4840-b4fc-a2907f7b8f1c", "tag": "2f2e239d-8035-4f37-96dd-4e4f3002af3d"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:58.668592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-dc97f7d6-2c39-42d5-91a2-53bb6804fe15 req-d0f75493-3a4e-4fac-8ebb-833e69587a80 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.669234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-dc97f7d6-2c39-42d5-91a2-53bb6804fe15 req-d0f75493-3a4e-4fac-8ebb-833e69587a80 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.669852 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-dc97f7d6-2c39-42d5-91a2-53bb6804fe15 req-d0f75493-3a4e-4fac-8ebb-833e69587a80 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.682235 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-dc97f7d6-2c39-42d5-91a2-53bb6804fe15 req-d0f75493-3a4e-4fac-8ebb-833e69587a80 service nova] Creating event network-changed:2f2e239d-8035-4f37-96dd-4e4f3002af3d for instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c on hv-cinder-73116 Aug 24 16:49:58.687799 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-dc97f7d6-2c39-42d5-91a2-53bb6804fe15 req-d0f75493-3a4e-4fac-8ebb-833e69587a80 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040431 Aug 24 16:49:58.689016 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 386/770] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:58.915048 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ddfc263d-1cff-4bc8-bf47-55121df87b94 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:58.915949 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ddfc263d-1cff-4bc8-bf47-55121df87b94 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:58.923357 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddfc263d-1cff-4bc8-bf47-55121df87b94 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.924754 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddfc263d-1cff-4bc8-bf47-55121df87b94 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.926027 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddfc263d-1cff-4bc8-bf47-55121df87b94 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.926972 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddfc263d-1cff-4bc8-bf47-55121df87b94 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.927628 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddfc263d-1cff-4bc8-bf47-55121df87b94 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.928281 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ddfc263d-1cff-4bc8-bf47-55121df87b94 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:59.050203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9acbb632-2e6f-4689-bf16-cd67ca7f1749 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:59.050402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9acbb632-2e6f-4689-bf16-cd67ca7f1749 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:59.077318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9acbb632-2e6f-4689-bf16-cd67ca7f1749 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:59.078642 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9acbb632-2e6f-4689-bf16-cd67ca7f1749 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:59.079729 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9acbb632-2e6f-4689-bf16-cd67ca7f1749 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:59.082250 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9acbb632-2e6f-4689-bf16-cd67ca7f1749 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:59.083413 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9acbb632-2e6f-4689-bf16-cd67ca7f1749 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:59.084902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9acbb632-2e6f-4689-bf16-cd67ca7f1749 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:59.399101 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ddfc263d-1cff-4bc8-bf47-55121df87b94 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:59.415869 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ddfc263d-1cff-4bc8-bf47-55121df87b94 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1237 microversion: 2.1 time: 0.508060 Aug 24 16:49:59.416517 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 385/771] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:58 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1237 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:59.719300 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9acbb632-2e6f-4689-bf16-cd67ca7f1749 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:59.728840 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9acbb632-2e6f-4689-bf16-cd67ca7f1749 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.698885 Aug 24 16:49:59.729459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 387/772] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:59 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:00.137489 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b17ff50b-f1c0-415e-a428-2cf8e68cc9a9 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Action: 'create', calling method: .version_select at 0x7f06a7575f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1634791995"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:00.456961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-184ce6dc-00c8-46d0-b903-4a7f55d3e5aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:00.458362 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-184ce6dc-00c8-46d0-b903-4a7f55d3e5aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:00.470486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-184ce6dc-00c8-46d0-b903-4a7f55d3e5aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:00.471340 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-184ce6dc-00c8-46d0-b903-4a7f55d3e5aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:00.472148 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-184ce6dc-00c8-46d0-b903-4a7f55d3e5aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:00.473415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-184ce6dc-00c8-46d0-b903-4a7f55d3e5aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:00.474250 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-184ce6dc-00c8-46d0-b903-4a7f55d3e5aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:00.475071 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-184ce6dc-00c8-46d0-b903-4a7f55d3e5aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:00.612662 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-184ce6dc-00c8-46d0-b903-4a7f55d3e5aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:00.624506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-184ce6dc-00c8-46d0-b903-4a7f55d3e5aa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1293 microversion: 2.1 time: 0.177232 Aug 24 16:50:00.625113 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 388/773] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:00 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1293 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:00.756509 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-75a9ac79-033e-4cc8-9d98-008acf30a839 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:00.757340 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-75a9ac79-033e-4cc8-9d98-008acf30a839 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:00.764947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-75a9ac79-033e-4cc8-9d98-008acf30a839 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:00.765455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-75a9ac79-033e-4cc8-9d98-008acf30a839 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:00.765895 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-75a9ac79-033e-4cc8-9d98-008acf30a839 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:00.766614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-75a9ac79-033e-4cc8-9d98-008acf30a839 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:00.767074 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-75a9ac79-033e-4cc8-9d98-008acf30a839 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:00.767497 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-75a9ac79-033e-4cc8-9d98-008acf30a839 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:01.132097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-75a9ac79-033e-4cc8-9d98-008acf30a839 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:01.141318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-75a9ac79-033e-4cc8-9d98-008acf30a839 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.389840 Aug 24 16:50:01.142707 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 389/774] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:00 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:01.150661 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-9a35ab47-09c0-4658-b11f-799c7068d766 req-b718ac10-6345-42e2-9ef1-73a60bd95d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b9c747-048e-4478-b065-0bd606ea331a", "tag": "01448d18-9692-445d-a2e1-37cc9a89b059"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:01.164407 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-9a35ab47-09c0-4658-b11f-799c7068d766 req-b718ac10-6345-42e2-9ef1-73a60bd95d46 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:01.164812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-9a35ab47-09c0-4658-b11f-799c7068d766 req-b718ac10-6345-42e2-9ef1-73a60bd95d46 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:01.165243 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-9a35ab47-09c0-4658-b11f-799c7068d766 req-b718ac10-6345-42e2-9ef1-73a60bd95d46 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:01.180453 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-9a35ab47-09c0-4658-b11f-799c7068d766 req-b718ac10-6345-42e2-9ef1-73a60bd95d46 service nova] Creating event network-changed:01448d18-9692-445d-a2e1-37cc9a89b059 for instance 09b9c747-048e-4478-b065-0bd606ea331a on hv-cinder-73116 Aug 24 16:50:01.186157 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-9a35ab47-09c0-4658-b11f-799c7068d766 req-b718ac10-6345-42e2-9ef1-73a60bd95d46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040927 Aug 24 16:50:01.187363 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 390/775] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:01.526614 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b17ff50b-f1c0-415e-a428-2cf8e68cc9a9 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.565982 Aug 24 16:50:01.528234 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 386/776] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Aug 24 16:49:59 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1568 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 16:50:01.558164 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-25cadfd0-cbe1-4dbe-b546-af09022c4a9e tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a6dc9f70>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:01.677241 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-649ec7dc-f65e-4d89-92c6-1289cf225a54 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:01.685560 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-649ec7dc-f65e-4d89-92c6-1289cf225a54 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:01.723004 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ec7dc-f65e-4d89-92c6-1289cf225a54 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:01.725979 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ec7dc-f65e-4d89-92c6-1289cf225a54 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:01.727121 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ec7dc-f65e-4d89-92c6-1289cf225a54 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:01.730913 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ec7dc-f65e-4d89-92c6-1289cf225a54 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:01.733057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ec7dc-f65e-4d89-92c6-1289cf225a54 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:01.745703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ec7dc-f65e-4d89-92c6-1289cf225a54 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:01.792876 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-25cadfd0-cbe1-4dbe-b546-af09022c4a9e tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7" status: 200 len: 345 microversion: 2.1 time: 0.253965 Aug 24 16:50:01.793790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 391/777] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:50:01 2022] GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 => generated 345 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:01.917806 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-649ec7dc-f65e-4d89-92c6-1289cf225a54 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:01.932525 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-649ec7dc-f65e-4d89-92c6-1289cf225a54 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1299 microversion: 2.1 time: 0.288564 Aug 24 16:50:01.948093 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 387/778] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:01 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1299 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:02.173236 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-39acb02f-f0a0-4f0e-8da8-912ccb3778a6 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:02.175262 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-39acb02f-f0a0-4f0e-8da8-912ccb3778a6 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:02.184763 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39acb02f-f0a0-4f0e-8da8-912ccb3778a6 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:02.186207 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39acb02f-f0a0-4f0e-8da8-912ccb3778a6 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:02.187105 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39acb02f-f0a0-4f0e-8da8-912ccb3778a6 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:02.188540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39acb02f-f0a0-4f0e-8da8-912ccb3778a6 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:02.190203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39acb02f-f0a0-4f0e-8da8-912ccb3778a6 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:02.191767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-39acb02f-f0a0-4f0e-8da8-912ccb3778a6 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:02.757807 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-39acb02f-f0a0-4f0e-8da8-912ccb3778a6 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:02.771879 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-39acb02f-f0a0-4f0e-8da8-912ccb3778a6 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.605686 Aug 24 16:50:02.773288 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 392/779] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:02 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:02.813861 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2a814ae0-b79e-4f2c-8df2-548a6c556e73 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a75308b0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:02.900064 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2a814ae0-b79e-4f2c-8df2-548a6c556e73 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7" status: 200 len: 346 microversion: 2.1 time: 0.089920 Aug 24 16:50:02.903853 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 388/780] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:50:02 2022] GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:50:02.929806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1b79aba3-9afc-482a-a7ca-6e4960df3c50 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Action: 'create', calling method: .version_select at 0x7f06a6d47040>, body: {"snapshot": {"volume_id": "1b165c19-54ea-4f38-a2bd-fbd47a3e02a7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-796911438"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:02.962571 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bd835696-0aa5-4d52-8493-a39df6d65b07 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:02.967387 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bd835696-0aa5-4d52-8493-a39df6d65b07 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:02.978698 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd835696-0aa5-4d52-8493-a39df6d65b07 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:02.979512 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd835696-0aa5-4d52-8493-a39df6d65b07 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:02.980114 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd835696-0aa5-4d52-8493-a39df6d65b07 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:02.981629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd835696-0aa5-4d52-8493-a39df6d65b07 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:02.982231 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd835696-0aa5-4d52-8493-a39df6d65b07 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:02.983220 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd835696-0aa5-4d52-8493-a39df6d65b07 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.297199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bd835696-0aa5-4d52-8493-a39df6d65b07 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:03.310349 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bd835696-0aa5-4d52-8493-a39df6d65b07 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1367 microversion: 2.1 time: 0.358174 Aug 24 16:50:03.311239 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 389/781] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:02 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:03.792882 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1b79aba3-9afc-482a-a7ca-6e4960df3c50 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.868747 Aug 24 16:50:03.793372 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 393/782] 10.222.0.17 () {60 vars in 1162 bytes} [Wed Aug 24 16:50:02 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:03.823206 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-61a427d6-d379-480e-9e41-6459139658ec tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:03.827034 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-61a427d6-d379-480e-9e41-6459139658ec tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:03.832296 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5af125f8-648f-447f-bb96-0b6399db20a2 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a6d2b160>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:03.857691 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61a427d6-d379-480e-9e41-6459139658ec tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:03.859151 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61a427d6-d379-480e-9e41-6459139658ec tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:03.859959 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61a427d6-d379-480e-9e41-6459139658ec tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.861470 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61a427d6-d379-480e-9e41-6459139658ec tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:03.863541 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61a427d6-d379-480e-9e41-6459139658ec tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:03.864592 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61a427d6-d379-480e-9e41-6459139658ec tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.933364 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5af125f8-648f-447f-bb96-0b6399db20a2 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f" status: 200 len: 286 microversion: 2.1 time: 0.126867 Aug 24 16:50:03.935347 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 394/783] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 16:50:03 2022] GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f => generated 286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:03.948139 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8b693e60-7722-470a-93a7-828ae1c7c36b tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a6d2baf0>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:03.994272 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8b693e60-7722-470a-93a7-828ae1c7c36b tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.051698 Aug 24 16:50:03.995832 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 395/784] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Aug 24 16:50:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:04.008895 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ce5d0dbc-883d-4978-ba66-fc7a49861d77 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a6e61550>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:04.080852 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ce5d0dbc-883d-4978-ba66-fc7a49861d77 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f" status: 200 len: 286 microversion: 2.1 time: 0.076003 Aug 24 16:50:04.089660 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 396/785] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 16:50:04 2022] GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:04.256093 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-61a427d6-d379-480e-9e41-6459139658ec tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:04.268682 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-61a427d6-d379-480e-9e41-6459139658ec tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.465566 Aug 24 16:50:04.270531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 390/786] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:03 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:04.336522 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0a356b0f-8063-41af-a4bf-3951d2cb49a7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:04.337167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0a356b0f-8063-41af-a4bf-3951d2cb49a7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:04.352217 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a356b0f-8063-41af-a4bf-3951d2cb49a7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:04.353086 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a356b0f-8063-41af-a4bf-3951d2cb49a7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:04.360075 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a356b0f-8063-41af-a4bf-3951d2cb49a7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:04.360075 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a356b0f-8063-41af-a4bf-3951d2cb49a7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:04.360075 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a356b0f-8063-41af-a4bf-3951d2cb49a7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:04.360075 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0a356b0f-8063-41af-a4bf-3951d2cb49a7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:04.679784 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0a356b0f-8063-41af-a4bf-3951d2cb49a7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:04.690593 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0a356b0f-8063-41af-a4bf-3951d2cb49a7 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1367 microversion: 2.1 time: 0.359142 Aug 24 16:50:04.704813 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 397/787] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:04 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:04.726201 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-378c624f-90a4-4eed-98e6-710085ef23fe req-01aee296-192c-4da4-a20b-22bc0e055dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdefed9-549e-4154-9e78-a9d762019d38", "tag": "186654be-fd06-4d31-aea4-c35029b08980"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:04.736416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-378c624f-90a4-4eed-98e6-710085ef23fe req-01aee296-192c-4da4-a20b-22bc0e055dc7 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:04.737118 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-378c624f-90a4-4eed-98e6-710085ef23fe req-01aee296-192c-4da4-a20b-22bc0e055dc7 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:04.738196 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-378c624f-90a4-4eed-98e6-710085ef23fe req-01aee296-192c-4da4-a20b-22bc0e055dc7 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:04.750415 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-378c624f-90a4-4eed-98e6-710085ef23fe req-01aee296-192c-4da4-a20b-22bc0e055dc7 service nova] Creating event network-changed:186654be-fd06-4d31-aea4-c35029b08980 for instance 5fdefed9-549e-4154-9e78-a9d762019d38 on hv-cinder-73116 Aug 24 16:50:04.757668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-378c624f-90a4-4eed-98e6-710085ef23fe req-01aee296-192c-4da4-a20b-22bc0e055dc7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036061 Aug 24 16:50:04.758300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 391/788] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:50:05.097370 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2978d175-cad5-4226-991b-9790650fb6e5 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a6d54e50>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:05.142451 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2978d175-cad5-4226-991b-9790650fb6e5 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f" status: 200 len: 286 microversion: 2.1 time: 0.050017 Aug 24 16:50:05.154070 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 398/789] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 16:50:05 2022] GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:05.297678 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e79cd63a-c3ff-4b1f-8b8e-8aeabb942136 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:05.298427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e79cd63a-c3ff-4b1f-8b8e-8aeabb942136 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:05.310672 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79cd63a-c3ff-4b1f-8b8e-8aeabb942136 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:05.311443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79cd63a-c3ff-4b1f-8b8e-8aeabb942136 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:05.311986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79cd63a-c3ff-4b1f-8b8e-8aeabb942136 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:05.312952 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79cd63a-c3ff-4b1f-8b8e-8aeabb942136 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:05.313641 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79cd63a-c3ff-4b1f-8b8e-8aeabb942136 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:05.314279 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79cd63a-c3ff-4b1f-8b8e-8aeabb942136 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:05.489936 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e79cd63a-c3ff-4b1f-8b8e-8aeabb942136 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:05.500494 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e79cd63a-c3ff-4b1f-8b8e-8aeabb942136 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.206126 Aug 24 16:50:05.500494 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 392/790] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:05 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:05.713899 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-299e194d-9279-4e33-916a-59fa0b9ca50c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:05.714636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-299e194d-9279-4e33-916a-59fa0b9ca50c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:05.727587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-299e194d-9279-4e33-916a-59fa0b9ca50c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:05.728085 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-299e194d-9279-4e33-916a-59fa0b9ca50c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:05.728733 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-299e194d-9279-4e33-916a-59fa0b9ca50c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:05.729673 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-299e194d-9279-4e33-916a-59fa0b9ca50c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:05.730656 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-299e194d-9279-4e33-916a-59fa0b9ca50c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:05.732801 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-299e194d-9279-4e33-916a-59fa0b9ca50c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:06.016408 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-299e194d-9279-4e33-916a-59fa0b9ca50c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:06.044887 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-299e194d-9279-4e33-916a-59fa0b9ca50c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1367 microversion: 2.1 time: 0.334877 Aug 24 16:50:06.046269 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 399/791] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:05 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:06.160934 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0b00e940-869e-4afe-8a97-92df81935c7c tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a745d940>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:06.169268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:06.170266 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=10 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:06.205327 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0b00e940-869e-4afe-8a97-92df81935c7c tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f" status: 200 len: 286 microversion: 2.1 time: 0.053206 Aug 24 16:50:06.206729 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 393/792] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 16:50:06 2022] GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:06.528056 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5a44af44-e8e8-4ee4-84ed-4b82a1193ebc tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:06.528698 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-5a44af44-e8e8-4ee4-84ed-4b82a1193ebc tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:06.535847 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a44af44-e8e8-4ee4-84ed-4b82a1193ebc tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:06.536645 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a44af44-e8e8-4ee4-84ed-4b82a1193ebc tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:06.537088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a44af44-e8e8-4ee4-84ed-4b82a1193ebc tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:06.537982 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a44af44-e8e8-4ee4-84ed-4b82a1193ebc tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:06.538442 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a44af44-e8e8-4ee4-84ed-4b82a1193ebc tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:06.538870 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5a44af44-e8e8-4ee4-84ed-4b82a1193ebc tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:06.755198 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5a44af44-e8e8-4ee4-84ed-4b82a1193ebc tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:06.759428 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=100 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:06.765528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5a44af44-e8e8-4ee4-84ed-4b82a1193ebc tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.245278 Aug 24 16:50:06.766562 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 400/793] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:06 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:07.072697 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c08055c1-95ed-46be-a0ae-8a2b9c367abf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:07.074166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c08055c1-95ed-46be-a0ae-8a2b9c367abf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:07.082578 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c08055c1-95ed-46be-a0ae-8a2b9c367abf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.083683 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c08055c1-95ed-46be-a0ae-8a2b9c367abf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.084384 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c08055c1-95ed-46be-a0ae-8a2b9c367abf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.085353 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c08055c1-95ed-46be-a0ae-8a2b9c367abf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.086461 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c08055c1-95ed-46be-a0ae-8a2b9c367abf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.087712 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c08055c1-95ed-46be-a0ae-8a2b9c367abf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.219530 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3a3ead40-30e4-442c-8c53-65e4033a8b90 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a6dc9dc0>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:07.274903 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3a3ead40-30e4-442c-8c53-65e4033a8b90 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f" status: 200 len: 286 microversion: 2.1 time: 0.054063 Aug 24 16:50:07.277704 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 401/794] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 16:50:07 2022] GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:07.382520 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c08055c1-95ed-46be-a0ae-8a2b9c367abf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:07.390886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c08055c1-95ed-46be-a0ae-8a2b9c367abf tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1367 microversion: 2.1 time: 0.326006 Aug 24 16:50:07.391925 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 394/795] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:07 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:07.792180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-dc04ac01-cbd9-4a10-b869-12b68058a7c3 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:07.794958 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-dc04ac01-cbd9-4a10-b869-12b68058a7c3 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:07.813865 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dc04ac01-cbd9-4a10-b869-12b68058a7c3 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.814720 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dc04ac01-cbd9-4a10-b869-12b68058a7c3 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.815976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dc04ac01-cbd9-4a10-b869-12b68058a7c3 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.818593 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dc04ac01-cbd9-4a10-b869-12b68058a7c3 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.819400 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dc04ac01-cbd9-4a10-b869-12b68058a7c3 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.820095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dc04ac01-cbd9-4a10-b869-12b68058a7c3 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.881051 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=4 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:08.145391 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-dc04ac01-cbd9-4a10-b869-12b68058a7c3 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:08.157328 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-dc04ac01-cbd9-4a10-b869-12b68058a7c3 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.372461 Aug 24 16:50:08.158319 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 402/796] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:07 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:08.293256 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2711b5e0-cfcb-4332-afa4-a01d8ab7fe54 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a74791f0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:08.327643 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2711b5e0-cfcb-4332-afa4-a01d8ab7fe54 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f" status: 200 len: 287 microversion: 2.1 time: 0.039130 Aug 24 16:50:08.328216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 395/797] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 16:50:08 2022] GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:08.341391 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e42a387e-b951-47a8-b1ea-921e47e85d3a tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a6d47a60>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:08.415106 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-271d9f87-09a1-4a66-a9a9-0a0682bcce05 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:08.416010 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-271d9f87-09a1-4a66-a9a9-0a0682bcce05 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:08.432180 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-271d9f87-09a1-4a66-a9a9-0a0682bcce05 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:08.432776 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-271d9f87-09a1-4a66-a9a9-0a0682bcce05 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:08.433228 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-271d9f87-09a1-4a66-a9a9-0a0682bcce05 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:08.433959 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-271d9f87-09a1-4a66-a9a9-0a0682bcce05 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:08.434459 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-271d9f87-09a1-4a66-a9a9-0a0682bcce05 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:08.434866 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-271d9f87-09a1-4a66-a9a9-0a0682bcce05 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:08.458214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:08.510204 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e42a387e-b951-47a8-b1ea-921e47e85d3a tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f" status: 202 len: 0 microversion: 2.1 time: 0.172671 Aug 24 16:50:08.510855 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 403/798] 10.222.0.17 () {58 vars in 1254 bytes} [Wed Aug 24 16:50:08 2022] DELETE /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:50:08.520774 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5d661453-6169-4f48-9317-9fb1f67d2359 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a6d2b790>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:08.554037 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5d661453-6169-4f48-9317-9fb1f67d2359 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f" status: 200 len: 286 microversion: 2.1 time: 0.038012 Aug 24 16:50:08.559760 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 404/799] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 16:50:08 2022] GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:08.604918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-271d9f87-09a1-4a66-a9a9-0a0682bcce05 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:08.613560 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-271d9f87-09a1-4a66-a9a9-0a0682bcce05 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1367 microversion: 2.1 time: 0.202917 Aug 24 16:50:08.614161 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 396/800] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:08 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:09.183017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-255e080e-4218-4019-8bb8-d58b6c71b428 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:09.184310 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-255e080e-4218-4019-8bb8-d58b6c71b428 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:09.194226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-255e080e-4218-4019-8bb8-d58b6c71b428 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:09.194852 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-255e080e-4218-4019-8bb8-d58b6c71b428 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:09.195391 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-255e080e-4218-4019-8bb8-d58b6c71b428 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:09.196250 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-255e080e-4218-4019-8bb8-d58b6c71b428 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:09.196825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-255e080e-4218-4019-8bb8-d58b6c71b428 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:09.197345 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-255e080e-4218-4019-8bb8-d58b6c71b428 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:09.342409 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-255e080e-4218-4019-8bb8-d58b6c71b428 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:09.351988 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-255e080e-4218-4019-8bb8-d58b6c71b428 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.174896 Aug 24 16:50:09.353348 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 405/801] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:09 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:09.567936 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-db67de38-9e34-4836-920c-3026175849ed tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a741daf0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:09.604686 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-db67de38-9e34-4836-920c-3026175849ed tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] HTTP exception thrown: Snapshot ff7c80cc-99cb-475f-964c-bff8deb5f24f could not be found. Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-db67de38-9e34-4836-920c-3026175849ed tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Request method failure captured: Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f HTTP/1.1 Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBla3579w1s3kxaVjEjiSImbYTxVB5BQWyT4tm1IrtlQuK6J-XCc0Qkl_-bIqr64xJwlJKpzrC7MCVd6dRq-vpDhnJdU5tW6ibQdt1fVbQg1NUxCtS7OBVhi_6Z21RQWjnao5752x0B9RmMyR7BwoEEQjh-jw92F-k-aXvG_Ydw3UZRo Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 28cb03a2e4b24023ba3030a48b882bc8 Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:50:09.607132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28cb03a2e4b24023ba3030a48b882bc8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 28cb03a2e4b24023ba3030a48b882bc8 Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesSnapshotsTestJSON-567400976-project Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 5d36c73bc2444787a5d6e77efca8c16b Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567400976-project Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Snapshot ff7c80cc-99cb-475f-964c-bff8deb5f24f could not be found. Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': 'ff7c80cc-99cb-475f-964c-bff8deb5f24f'} Aug 24 16:50:09.619975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ff7c80cc-99cb-475f-964c-bff8deb5f24f could not be found. (HTTP 404) (Request-ID: req-c8fa7789-460d-4ca4-9f49-ff86e06f27d7) Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:09.620867 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:50:09.623618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ff7c80cc-99cb-475f-964c-bff8deb5f24f could not be found. Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 16:50:09.627625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ff7c80cc-99cb-475f-964c-bff8deb5f24f could not be found. Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ff7c80cc-99cb-475f-964c-bff8deb5f24f could not be found. Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-db67de38-9e34-4836-920c-3026175849ed tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Returning 404 to user: Snapshot ff7c80cc-99cb-475f-964c-bff8deb5f24f could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-db67de38-9e34-4836-920c-3026175849ed tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f" status: 404 len: 111 microversion: 2.1 time: 0.045114 Aug 24 16:50:09.629416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 397/802] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 16:50:09 2022] GET /compute/v2.1/os-snapshots/ff7c80cc-99cb-475f-964c-bff8deb5f24f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:09.630911 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3ad065ec-0fab-4f8a-9d65-45a94bdeff44 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a6d47160>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:09.634681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-05e85d3a-cbd5-4646-bc2b-d9a48d8dd39f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:09.639643 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-05e85d3a-cbd5-4646-bc2b-d9a48d8dd39f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:09.647578 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05e85d3a-cbd5-4646-bc2b-d9a48d8dd39f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:09.647578 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05e85d3a-cbd5-4646-bc2b-d9a48d8dd39f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:09.647578 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05e85d3a-cbd5-4646-bc2b-d9a48d8dd39f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:09.648673 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05e85d3a-cbd5-4646-bc2b-d9a48d8dd39f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:09.648985 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05e85d3a-cbd5-4646-bc2b-d9a48d8dd39f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:09.649713 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05e85d3a-cbd5-4646-bc2b-d9a48d8dd39f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:09.853379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-05e85d3a-cbd5-4646-bc2b-d9a48d8dd39f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:09.865390 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-05e85d3a-cbd5-4646-bc2b-d9a48d8dd39f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1367 microversion: 2.1 time: 0.231921 Aug 24 16:50:09.865390 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 398/803] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:09 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:10.046682 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3ad065ec-0fab-4f8a-9d65-45a94bdeff44 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7" status: 202 len: 0 microversion: 2.1 time: 0.417336 Aug 24 16:50:10.046682 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 406/804] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 16:50:09 2022] DELETE /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 16:50:10.047474 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-28231ac0-4c67-4033-8993-40cd5e7af46e tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a7509310>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:10.114177 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-28231ac0-4c67-4033-8993-40cd5e7af46e tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7" status: 200 len: 345 microversion: 2.1 time: 0.071518 Aug 24 16:50:10.115359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 399/805] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:50:10 2022] GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:10.381965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9004e945-f91f-4ac2-ae44-9efe81cc5624 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:10.381965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9004e945-f91f-4ac2-ae44-9efe81cc5624 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:10.392748 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9004e945-f91f-4ac2-ae44-9efe81cc5624 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:10.393937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9004e945-f91f-4ac2-ae44-9efe81cc5624 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:10.394389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9004e945-f91f-4ac2-ae44-9efe81cc5624 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:10.395115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9004e945-f91f-4ac2-ae44-9efe81cc5624 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:10.395579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9004e945-f91f-4ac2-ae44-9efe81cc5624 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:10.396057 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9004e945-f91f-4ac2-ae44-9efe81cc5624 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:10.584466 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-673f3ea7-da83-42e3-b008-8cee4408bb45 req-b440c543-88ec-4e8b-b5fa-f11195c76c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4ea3cd-ed8d-4169-8be6-716b693de76d", "name": "network-vif-plugged", "status": "completed", "tag": "a3e2b5de-778c-4f0f-bb74-761971b6f904"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:10.609717 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-673f3ea7-da83-42e3-b008-8cee4408bb45 req-b440c543-88ec-4e8b-b5fa-f11195c76c4c service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:10.610655 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-673f3ea7-da83-42e3-b008-8cee4408bb45 req-b440c543-88ec-4e8b-b5fa-f11195c76c4c service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:10.611310 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-673f3ea7-da83-42e3-b008-8cee4408bb45 req-b440c543-88ec-4e8b-b5fa-f11195c76c4c service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:10.637610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-673f3ea7-da83-42e3-b008-8cee4408bb45 req-b440c543-88ec-4e8b-b5fa-f11195c76c4c service nova] Creating event network-vif-plugged:a3e2b5de-778c-4f0f-bb74-761971b6f904 for instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d on hv-cinder-73116 Aug 24 16:50:10.659996 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-673f3ea7-da83-42e3-b008-8cee4408bb45 req-b440c543-88ec-4e8b-b5fa-f11195c76c4c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174338 Aug 24 16:50:10.669361 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 400/806] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:50:10.692404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9004e945-f91f-4ac2-ae44-9efe81cc5624 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:10.726161 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9004e945-f91f-4ac2-ae44-9efe81cc5624 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.349794 Aug 24 16:50:10.726804 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 407/807] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:10 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:10.896529 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-17bd6260-b472-4bf6-8bd3-c2f22bcad416 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:10.896529 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-17bd6260-b472-4bf6-8bd3-c2f22bcad416 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:10.917051 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17bd6260-b472-4bf6-8bd3-c2f22bcad416 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:10.917682 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17bd6260-b472-4bf6-8bd3-c2f22bcad416 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:10.918267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17bd6260-b472-4bf6-8bd3-c2f22bcad416 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:10.919162 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17bd6260-b472-4bf6-8bd3-c2f22bcad416 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:10.919551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17bd6260-b472-4bf6-8bd3-c2f22bcad416 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:10.919971 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-17bd6260-b472-4bf6-8bd3-c2f22bcad416 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:11.140893 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-559d4423-2219-4b12-b5ca-81082a2845ca tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a6d478b0>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:11.186301 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-559d4423-2219-4b12-b5ca-81082a2845ca tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] HTTP exception thrown: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-559d4423-2219-4b12-b5ca-81082a2845ca tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Request method failure captured: Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 HTTP/1.1 Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBla3579w1s3kxaVjEjiSImbYTxVB5BQWyT4tm1IrtlQuK6J-XCc0Qkl_-bIqr64xJwlJKpzrC7MCVd6dRq-vpDhnJdU5tW6ibQdt1fVbQg1NUxCtS7OBVhi_6Z21RQWjnao5752x0B9RmMyR7BwoEEQjh-jw92F-k-aXvG_Ydw3UZRo Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 28cb03a2e4b24023ba3030a48b882bc8 Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:50:11.190416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28cb03a2e4b24023ba3030a48b882bc8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 28cb03a2e4b24023ba3030a48b882bc8 Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-VolumesSnapshotsTestJSON-567400976-project Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 5d36c73bc2444787a5d6e77efca8c16b Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567400976-project Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '1b165c19-54ea-4f38-a2bd-fbd47a3e02a7'} Aug 24 16:50:11.192153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. (HTTP 404) (Request-ID: req-087b191e-6ec4-4e77-97aa-d01f17bee452) Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:11.192976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:50:11.196540 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 16:50:11.198049 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-559d4423-2219-4b12-b5ca-81082a2845ca tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Returning 404 to user: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-559d4423-2219-4b12-b5ca-81082a2845ca tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7" status: 404 len: 109 microversion: 2.1 time: 0.063154 Aug 24 16:50:11.199323 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 408/808] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:50:11 2022] GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:11.213895 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-68dbfeff-3c17-46d2-ac37-a8ab7f5d5f21 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a6d2b790>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:11.247529 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-17bd6260-b472-4bf6-8bd3-c2f22bcad416 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:11.259493 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-68dbfeff-3c17-46d2-ac37-a8ab7f5d5f21 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] HTTP exception thrown: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.260632 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-17bd6260-b472-4bf6-8bd3-c2f22bcad416 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1367 microversion: 2.1 time: 0.376846 Aug 24 16:50:11.261438 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 401/809] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:10 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-68dbfeff-3c17-46d2-ac37-a8ab7f5d5f21 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Request method failure captured: Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: DELETE /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 HTTP/1.1 Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBla3579w1s3kxaVjEjiSImbYTxVB5BQWyT4tm1IrtlQuK6J-XCc0Qkl_-bIqr64xJwlJKpzrC7MCVd6dRq-vpDhnJdU5tW6ibQdt1fVbQg1NUxCtS7OBVhi_6Z21RQWjnao5752x0B9RmMyR7BwoEEQjh-jw92F-k-aXvG_Ydw3UZRo Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 28cb03a2e4b24023ba3030a48b882bc8 Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:50:11.262587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28cb03a2e4b24023ba3030a48b882bc8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 28cb03a2e4b24023ba3030a48b882bc8 Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-VolumesSnapshotsTestJSON-567400976-project Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 5d36c73bc2444787a5d6e77efca8c16b Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567400976-project Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '1b165c19-54ea-4f38-a2bd-fbd47a3e02a7'} Aug 24 16:50:11.264242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. (HTTP 404) (Request-ID: req-9dacfb69-7987-4885-8759-b296a18152d2) Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:11.265507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:50:11.267536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 16:50:11.268959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-68dbfeff-3c17-46d2-ac37-a8ab7f5d5f21 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Returning 404 to user: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-68dbfeff-3c17-46d2-ac37-a8ab7f5d5f21 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7" status: 404 len: 109 microversion: 2.1 time: 0.057570 Aug 24 16:50:11.275007 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 409/810] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 16:50:11 2022] DELETE /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:50:11.281960 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d474cec4-f710-43df-9210-703491429165 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Calling method '.version_select at 0x7f06a745d5e0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:11.332003 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-d474cec4-f710-43df-9210-703491429165 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] HTTP exception thrown: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d474cec4-f710-43df-9210-703491429165 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Request method failure captured: Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 HTTP/1.1 Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBla3579w1s3kxaVjEjiSImbYTxVB5BQWyT4tm1IrtlQuK6J-XCc0Qkl_-bIqr64xJwlJKpzrC7MCVd6dRq-vpDhnJdU5tW6ibQdt1fVbQg1NUxCtS7OBVhi_6Z21RQWjnao5752x0B9RmMyR7BwoEEQjh-jw92F-k-aXvG_Ydw3UZRo Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 28cb03a2e4b24023ba3030a48b882bc8 Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:50:11.333077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_28cb03a2e4b24023ba3030a48b882bc8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/28cb03a2e4b24023ba3030a48b882bc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 28cb03a2e4b24023ba3030a48b882bc8 Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567400976 Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesSnapshotsTestJSON-567400976-project Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 5d36c73bc2444787a5d6e77efca8c16b Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567400976-project Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '1b165c19-54ea-4f38-a2bd-fbd47a3e02a7'} Aug 24 16:50:11.335136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. (HTTP 404) (Request-ID: req-ee762c2c-d1c0-4eef-9e5f-c8f2d3293f9a) Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:11.335907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:50:11.337479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 16:50:11.339613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d474cec4-f710-43df-9210-703491429165 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] Returning 404 to user: Volume 1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:11.342412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d474cec4-f710-43df-9210-703491429165 tempest-VolumesSnapshotsTestJSON-567400976 tempest-VolumesSnapshotsTestJSON-567400976-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7" status: 404 len: 109 microversion: 2.1 time: 0.057554 Aug 24 16:50:11.349653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 402/811] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 16:50:11 2022] GET /compute/v2.1/os-volumes/1b165c19-54ea-4f38-a2bd-fbd47a3e02a7 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:11.760874 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8afc7dca-cb76-426d-a6c4-e6c70ca5caee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:11.761485 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8afc7dca-cb76-426d-a6c4-e6c70ca5caee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:11.767676 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8afc7dca-cb76-426d-a6c4-e6c70ca5caee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:11.768125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8afc7dca-cb76-426d-a6c4-e6c70ca5caee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:11.776053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8afc7dca-cb76-426d-a6c4-e6c70ca5caee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:11.776053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8afc7dca-cb76-426d-a6c4-e6c70ca5caee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:11.776053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8afc7dca-cb76-426d-a6c4-e6c70ca5caee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:11.776053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8afc7dca-cb76-426d-a6c4-e6c70ca5caee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:11.941898 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8afc7dca-cb76-426d-a6c4-e6c70ca5caee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:11.950185 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8afc7dca-cb76-426d-a6c4-e6c70ca5caee tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.193721 Aug 24 16:50:11.950786 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 410/812] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:11 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:12.290880 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-03494477-2ebd-4a2e-81c2-122588c82dce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:12.292798 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-03494477-2ebd-4a2e-81c2-122588c82dce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:12.306647 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03494477-2ebd-4a2e-81c2-122588c82dce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:12.307709 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03494477-2ebd-4a2e-81c2-122588c82dce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:12.308570 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03494477-2ebd-4a2e-81c2-122588c82dce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:12.309642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03494477-2ebd-4a2e-81c2-122588c82dce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:12.310144 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03494477-2ebd-4a2e-81c2-122588c82dce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:12.311524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03494477-2ebd-4a2e-81c2-122588c82dce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:12.468449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-03494477-2ebd-4a2e-81c2-122588c82dce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:12.479254 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-03494477-2ebd-4a2e-81c2-122588c82dce tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1367 microversion: 2.1 time: 0.195508 Aug 24 16:50:12.492385 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 403/813] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:12 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:12.973032 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f866d18f-e7ca-4c3b-8974-cf9251e9c200 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:12.973768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f866d18f-e7ca-4c3b-8974-cf9251e9c200 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:12.980210 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f866d18f-e7ca-4c3b-8974-cf9251e9c200 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:12.980724 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f866d18f-e7ca-4c3b-8974-cf9251e9c200 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:12.984871 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f866d18f-e7ca-4c3b-8974-cf9251e9c200 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:12.984871 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f866d18f-e7ca-4c3b-8974-cf9251e9c200 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:12.984871 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f866d18f-e7ca-4c3b-8974-cf9251e9c200 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:12.984871 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f866d18f-e7ca-4c3b-8974-cf9251e9c200 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:13.147543 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f866d18f-e7ca-4c3b-8974-cf9251e9c200 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:13.156768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f866d18f-e7ca-4c3b-8974-cf9251e9c200 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1575 microversion: 2.1 time: 0.187557 Aug 24 16:50:13.157814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 411/814] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:12 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:13.502411 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f7c626d4-b8f7-4585-8cab-adeb6b5b612f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:13.503544 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f7c626d4-b8f7-4585-8cab-adeb6b5b612f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:13.510454 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7c626d4-b8f7-4585-8cab-adeb6b5b612f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:13.510941 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7c626d4-b8f7-4585-8cab-adeb6b5b612f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:13.511372 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7c626d4-b8f7-4585-8cab-adeb6b5b612f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:13.512063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7c626d4-b8f7-4585-8cab-adeb6b5b612f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:13.512553 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7c626d4-b8f7-4585-8cab-adeb6b5b612f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:13.512976 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7c626d4-b8f7-4585-8cab-adeb6b5b612f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:13.670228 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f7c626d4-b8f7-4585-8cab-adeb6b5b612f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:13.680735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f7c626d4-b8f7-4585-8cab-adeb6b5b612f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1367 microversion: 2.1 time: 0.181933 Aug 24 16:50:13.694752 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 404/815] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:13 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:14.182245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-47328fdf-ee28-45b8-b3e7-c3efa621c2ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:14.183092 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-47328fdf-ee28-45b8-b3e7-c3efa621c2ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:14.191001 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-47328fdf-ee28-45b8-b3e7-c3efa621c2ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:14.191848 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-47328fdf-ee28-45b8-b3e7-c3efa621c2ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:14.192535 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-47328fdf-ee28-45b8-b3e7-c3efa621c2ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:14.193262 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-47328fdf-ee28-45b8-b3e7-c3efa621c2ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:14.193730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-47328fdf-ee28-45b8-b3e7-c3efa621c2ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:14.194176 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-47328fdf-ee28-45b8-b3e7-c3efa621c2ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:14.361912 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-47328fdf-ee28-45b8-b3e7-c3efa621c2ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:14.372035 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-47328fdf-ee28-45b8-b3e7-c3efa621c2ab tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1562 microversion: 2.1 time: 0.197174 Aug 24 16:50:14.373253 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 412/816] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:14 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1562 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:14.483752 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-3f5cb37d-0ce2-4ff2-bbd6-f3c57a325ffa req-8b082122-3502-4194-b7eb-b6c852179509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdefed9-549e-4154-9e78-a9d762019d38", "name": "network-vif-plugged", "status": "completed", "tag": "186654be-fd06-4d31-aea4-c35029b08980"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:14.493850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-3f5cb37d-0ce2-4ff2-bbd6-f3c57a325ffa req-8b082122-3502-4194-b7eb-b6c852179509 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:14.494388 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-3f5cb37d-0ce2-4ff2-bbd6-f3c57a325ffa req-8b082122-3502-4194-b7eb-b6c852179509 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:14.494808 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-3f5cb37d-0ce2-4ff2-bbd6-f3c57a325ffa req-8b082122-3502-4194-b7eb-b6c852179509 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:14.510579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-3f5cb37d-0ce2-4ff2-bbd6-f3c57a325ffa req-8b082122-3502-4194-b7eb-b6c852179509 service nova] Creating event network-vif-plugged:186654be-fd06-4d31-aea4-c35029b08980 for instance 5fdefed9-549e-4154-9e78-a9d762019d38 on hv-cinder-73116 Aug 24 16:50:14.517012 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-3f5cb37d-0ce2-4ff2-bbd6-f3c57a325ffa req-8b082122-3502-4194-b7eb-b6c852179509 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037907 Aug 24 16:50:14.517794 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 405/817] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:14.705626 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-03fc4476-93be-4b6f-abfb-1273822b30a2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:14.706827 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-03fc4476-93be-4b6f-abfb-1273822b30a2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:14.712921 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03fc4476-93be-4b6f-abfb-1273822b30a2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:14.713445 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03fc4476-93be-4b6f-abfb-1273822b30a2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:14.713883 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03fc4476-93be-4b6f-abfb-1273822b30a2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:14.714891 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03fc4476-93be-4b6f-abfb-1273822b30a2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:14.715618 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03fc4476-93be-4b6f-abfb-1273822b30a2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:14.716053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03fc4476-93be-4b6f-abfb-1273822b30a2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:14.901975 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-03fc4476-93be-4b6f-abfb-1273822b30a2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:14.911452 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-03fc4476-93be-4b6f-abfb-1273822b30a2 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1367 microversion: 2.1 time: 0.209730 Aug 24 16:50:14.912061 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 413/818] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:14 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:15.934309 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a7572cd6-996c-47d5-91e5-3ad69b8105ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:15.935034 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a7572cd6-996c-47d5-91e5-3ad69b8105ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:15.942711 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7572cd6-996c-47d5-91e5-3ad69b8105ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:15.943204 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7572cd6-996c-47d5-91e5-3ad69b8105ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:15.943653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7572cd6-996c-47d5-91e5-3ad69b8105ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:15.944377 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7572cd6-996c-47d5-91e5-3ad69b8105ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:15.944841 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7572cd6-996c-47d5-91e5-3ad69b8105ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:15.945273 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7572cd6-996c-47d5-91e5-3ad69b8105ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:16.115167 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a7572cd6-996c-47d5-91e5-3ad69b8105ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:16.124100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a7572cd6-996c-47d5-91e5-3ad69b8105ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1367 microversion: 2.1 time: 0.194638 Aug 24 16:50:16.124806 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 406/819] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:15 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:17.146909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-15632be9-0ca5-4ec2-acec-c42371cc8b45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:17.147567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-15632be9-0ca5-4ec2-acec-c42371cc8b45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:17.154642 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15632be9-0ca5-4ec2-acec-c42371cc8b45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:17.154947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15632be9-0ca5-4ec2-acec-c42371cc8b45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:17.156539 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15632be9-0ca5-4ec2-acec-c42371cc8b45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:17.156539 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15632be9-0ca5-4ec2-acec-c42371cc8b45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:17.156539 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15632be9-0ca5-4ec2-acec-c42371cc8b45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:17.156976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-15632be9-0ca5-4ec2-acec-c42371cc8b45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:17.302297 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-15632be9-0ca5-4ec2-acec-c42371cc8b45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:17.315047 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-15632be9-0ca5-4ec2-acec-c42371cc8b45 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1558 microversion: 2.1 time: 0.172614 Aug 24 16:50:17.316191 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 414/820] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:17 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:17.338223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-813eaa4b-310d-4adb-b5a5-fbd711a895d1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:17.340316 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-813eaa4b-310d-4adb-b5a5-fbd711a895d1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:17.345700 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-813eaa4b-310d-4adb-b5a5-fbd711a895d1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:17.346197 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-813eaa4b-310d-4adb-b5a5-fbd711a895d1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:17.346829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-813eaa4b-310d-4adb-b5a5-fbd711a895d1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:17.347395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-813eaa4b-310d-4adb-b5a5-fbd711a895d1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:17.347843 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-813eaa4b-310d-4adb-b5a5-fbd711a895d1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:17.348368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-813eaa4b-310d-4adb-b5a5-fbd711a895d1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:17.436113 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-813eaa4b-310d-4adb-b5a5-fbd711a895d1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102296 Aug 24 16:50:17.436736 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 407/821] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 16:50:17 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:18.837839 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-41b309b1-a7e7-4925-b069-b05794b3c5cd req-01327fcb-447b-4406-9be7-eaa524fb1d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdefed9-549e-4154-9e78-a9d762019d38", "tag": "186654be-fd06-4d31-aea4-c35029b08980"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:18.849783 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-41b309b1-a7e7-4925-b069-b05794b3c5cd req-01327fcb-447b-4406-9be7-eaa524fb1d63 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:18.850578 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-41b309b1-a7e7-4925-b069-b05794b3c5cd req-01327fcb-447b-4406-9be7-eaa524fb1d63 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:18.851354 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-41b309b1-a7e7-4925-b069-b05794b3c5cd req-01327fcb-447b-4406-9be7-eaa524fb1d63 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:18.873135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-41b309b1-a7e7-4925-b069-b05794b3c5cd req-01327fcb-447b-4406-9be7-eaa524fb1d63 service nova] Creating event network-changed:186654be-fd06-4d31-aea4-c35029b08980 for instance 5fdefed9-549e-4154-9e78-a9d762019d38 on hv-cinder-73116 Aug 24 16:50:18.879152 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-41b309b1-a7e7-4925-b069-b05794b3c5cd req-01327fcb-447b-4406-9be7-eaa524fb1d63 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046938 Aug 24 16:50:18.879880 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 415/822] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:42.732005 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:42.732902 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=40 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:42.737237 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-730bd840-4b1a-4aa1-bb6f-9ed82f01b76f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:42.737796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-730bd840-4b1a-4aa1-bb6f-9ed82f01b76f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:42.746126 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-730bd840-4b1a-4aa1-bb6f-9ed82f01b76f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:42.746126 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-730bd840-4b1a-4aa1-bb6f-9ed82f01b76f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:42.746126 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-730bd840-4b1a-4aa1-bb6f-9ed82f01b76f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:42.746749 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-730bd840-4b1a-4aa1-bb6f-9ed82f01b76f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:42.747368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-730bd840-4b1a-4aa1-bb6f-9ed82f01b76f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:42.748095 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-730bd840-4b1a-4aa1-bb6f-9ed82f01b76f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:42.787189 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-730bd840-4b1a-4aa1-bb6f-9ed82f01b76f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/ips" status: 200 len: 151 microversion: 2.20 time: 0.056865 Aug 24 16:50:42.787918 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 408/823] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Aug 24 16:50:42 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:50:45.175174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d2f9ba78-e9eb-437f-a8c4-837ea7025063 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:45.175818 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d2f9ba78-e9eb-437f-a8c4-837ea7025063 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:45.178162 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:45.178836 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=50 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:45.184006 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2f9ba78-e9eb-437f-a8c4-837ea7025063 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:45.184531 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2f9ba78-e9eb-437f-a8c4-837ea7025063 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:45.184965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2f9ba78-e9eb-437f-a8c4-837ea7025063 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:45.185667 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2f9ba78-e9eb-437f-a8c4-837ea7025063 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:45.186173 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2f9ba78-e9eb-437f-a8c4-837ea7025063 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:45.186592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2f9ba78-e9eb-437f-a8c4-837ea7025063 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:45.212418 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d2f9ba78-e9eb-437f-a8c4-837ea7025063 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/ips" status: 200 len: 146 microversion: 2.1 time: 0.041870 Aug 24 16:50:45.213008 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 416/824] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 16:50:45 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:48.427978 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4c6fecc5-7b67-4123-bc52-2331f999f2d5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:48.428900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4c6fecc5-7b67-4123-bc52-2331f999f2d5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:48.439689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c6fecc5-7b67-4123-bc52-2331f999f2d5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:48.439689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c6fecc5-7b67-4123-bc52-2331f999f2d5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:48.439689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c6fecc5-7b67-4123-bc52-2331f999f2d5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:48.440252 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c6fecc5-7b67-4123-bc52-2331f999f2d5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:48.440744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c6fecc5-7b67-4123-bc52-2331f999f2d5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:48.441347 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c6fecc5-7b67-4123-bc52-2331f999f2d5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:48.466874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-4c6fecc5-7b67-4123-bc52-2331f999f2d5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lazy-loading 'flavor' on Instance uuid 75145055-cbf0-4840-b4fc-a2907f7b8f1c {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:50:49.024914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4c6fecc5-7b67-4123-bc52-2331f999f2d5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "POST /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/action" status: 202 len: 0 microversion: 2.20 time: 0.603317 Aug 24 16:50:49.025522 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 409/825] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 24 16:50:48 2022] POST /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:49.037543 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:49.038344 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:49.046490 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:49.046983 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:49.047456 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:49.048176 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:49.048676 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:49.049166 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:49.210800 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:49.226404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:49.227918 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:49.232387 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d264a52d-a8a7-4ab8-b801-d78d95785b88 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.198112 Aug 24 16:50:49.232387 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 417/826] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:50:49 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:50:50.254826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:50.255530 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:50.263215 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:50.271537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:50.271537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:50.271537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:50.271537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:50.272183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:50.373660 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-aeab6637-2e12-46ba-93a2-a6ae15d09e04 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28f255a5-0e36-4827-b20d-df00fca2a98e"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:50.376850 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-aeab6637-2e12-46ba-93a2-a6ae15d09e04 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:50.387424 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeab6637-2e12-46ba-93a2-a6ae15d09e04 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:50.392056 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeab6637-2e12-46ba-93a2-a6ae15d09e04 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:50.392056 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeab6637-2e12-46ba-93a2-a6ae15d09e04 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:50.392056 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeab6637-2e12-46ba-93a2-a6ae15d09e04 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:50.392056 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeab6637-2e12-46ba-93a2-a6ae15d09e04 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:50.393256 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-aeab6637-2e12-46ba-93a2-a6ae15d09e04 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:50.461868 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:50.471572 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:50.474937 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:50.477087 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-438afb52-4063-42f5-b5e3-ff576fde5efa tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.227349 Aug 24 16:50:50.478062 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 410/827] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:50:50 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:50:51.513281 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:51.514034 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:51.521492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:51.521995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:51.522438 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:51.523180 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:51.523634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:51.524059 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:51.636525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-aeab6637-2e12-46ba-93a2-a6ae15d09e04 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "POST /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.267752 Aug 24 16:50:51.641198 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 418/828] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:50:50 2022] POST /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments => generated 194 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:51.673438 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:51.685079 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:51.686594 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:51.687784 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fd2f9b05-fd45-4d0e-a3d4-013db82cf78f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.179839 Aug 24 16:50:51.688564 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 411/829] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:50:51 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:50:52.732637 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:52.733353 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:52.740990 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:52.742062 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:52.742788 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:52.743216 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:52.743679 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:52.744126 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:52.921361 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:52.934516 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:52.936027 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:52.937251 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-dce64956-e1be-473c-857f-79aa4b9a5041 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.209445 Aug 24 16:50:52.937821 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 419/830] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:50:52 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:50:53.961378 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:53.962089 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:53.969044 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:53.969542 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:53.969971 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:53.970674 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:53.971120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:53.971600 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:54.114989 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:54.123374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:54.124902 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:54.126064 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8a6462ff-ea3c-4a80-943c-978bb44be2d9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.170332 Aug 24 16:50:54.126786 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 412/831] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:50:53 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:50:55.150064 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:55.150677 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:55.157078 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:55.157563 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:55.157994 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:55.158697 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:55.159405 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:55.159825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:55.298315 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:55.307013 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:55.308577 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:55.309754 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a2b6c03b-6bd0-49cb-9b10-5138e04ab8a3 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.163806 Aug 24 16:50:55.310324 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 420/832] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:50:55 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:50:56.333181 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:56.333823 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:56.340445 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:56.340969 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:56.341450 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:56.342156 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:56.342612 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:56.343035 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:56.486013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:56.494690 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:56.496335 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:56.497493 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f322e180-3199-4028-85e4-3f8dd4769a4a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.169063 Aug 24 16:50:56.498158 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 413/833] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:50:56 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:50:57.525733 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:57.526324 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:57.532812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:57.533302 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:57.533745 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:57.534452 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:57.534916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:57.535345 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:57.690978 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:57.701577 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:57.703197 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:57.704749 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-154b84fe-99af-44f2-8187-8cb13e4b5e93 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.183761 Aug 24 16:50:57.705480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 421/834] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:50:57 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:50:58.736944 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:58.736944 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:58.736944 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:58.737754 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:58.737754 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:58.738780 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:58.739979 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:58.740774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:58.883425 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:58.891928 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:58.893470 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:58.895612 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8a02ab9c-af16-4636-87c8-1bad15d3c66b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.169857 Aug 24 16:50:58.897150 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 414/835] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:50:58 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:50:59.922723 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:59.923334 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:59.930702 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:59.931189 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:59.931644 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:59.932324 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:59.932837 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:59.933286 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:00.074979 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:00.083221 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:00.084735 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:00.085886 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ad7cf13b-d195-44eb-80c7-169e0217a488 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.167082 Aug 24 16:51:00.086445 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 422/836] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:50:59 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:00.249317 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2a6c1cfa-7aed-4a39-a789-b8c93f255992 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:00.251687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2a6c1cfa-7aed-4a39-a789-b8c93f255992 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:00.258713 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a6c1cfa-7aed-4a39-a789-b8c93f255992 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:00.259196 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a6c1cfa-7aed-4a39-a789-b8c93f255992 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:00.259625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a6c1cfa-7aed-4a39-a789-b8c93f255992 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:00.260317 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a6c1cfa-7aed-4a39-a789-b8c93f255992 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:00.260784 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a6c1cfa-7aed-4a39-a789-b8c93f255992 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:00.261202 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2a6c1cfa-7aed-4a39-a789-b8c93f255992 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:00.303339 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2a6c1cfa-7aed-4a39-a789-b8c93f255992 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057851 Aug 24 16:51:00.303905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 415/837] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:51:00 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:00.314750 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ce908338-6c18-4835-b004-7a8abd7f728b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:00.315254 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ce908338-6c18-4835-b004-7a8abd7f728b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:00.321511 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce908338-6c18-4835-b004-7a8abd7f728b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:00.321996 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce908338-6c18-4835-b004-7a8abd7f728b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:00.322433 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce908338-6c18-4835-b004-7a8abd7f728b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:00.323127 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce908338-6c18-4835-b004-7a8abd7f728b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:00.323573 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce908338-6c18-4835-b004-7a8abd7f728b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:00.324023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ce908338-6c18-4835-b004-7a8abd7f728b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:00.353892 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ce908338-6c18-4835-b004-7a8abd7f728b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments/28f255a5-0e36-4827-b20d-df00fca2a98e" status: 200 len: 194 microversion: 2.1 time: 0.043009 Aug 24 16:51:00.354398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 423/838] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Aug 24 16:51:00 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments/28f255a5-0e36-4827-b20d-df00fca2a98e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:01.109451 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:01.110080 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:01.116883 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:01.117413 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:01.117844 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:01.118535 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:01.118982 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:01.119422 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:01.260891 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:01.267764 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:01.269379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:01.270908 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-09f32998-5c95-426b-9dd3-af39098d49c1 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.165197 Aug 24 16:51:01.271600 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 416/839] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:01 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:02.295417 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:02.296059 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:02.303290 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:02.303786 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:02.304223 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:02.304965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:02.305420 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:02.305845 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:02.449181 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:02.463566 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:02.465100 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:02.466278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3620e7ce-92ff-48df-ba26-1379aabb01e4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.174984 Aug 24 16:51:02.466860 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 424/840] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:02 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:03.491741 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:03.492387 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:03.498869 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:03.499358 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:03.499788 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:03.500514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:03.500968 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:03.501390 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:03.646257 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:03.655284 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:03.656852 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:03.658219 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7dae8d62-23e8-40f2-b878-383329ee232e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.171400 Aug 24 16:51:03.658812 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 417/841] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:03 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:04.430859 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5bb68604-f21b-401b-9851-e6d7d5d9f8ca tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27b415f5-4d38-4056-9c1f-af39e6cd22a7"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:04.433369 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-5bb68604-f21b-401b-9851-e6d7d5d9f8ca tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:04.439882 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5bb68604-f21b-401b-9851-e6d7d5d9f8ca tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:04.440397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5bb68604-f21b-401b-9851-e6d7d5d9f8ca tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:04.440841 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5bb68604-f21b-401b-9851-e6d7d5d9f8ca tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:04.441549 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5bb68604-f21b-401b-9851-e6d7d5d9f8ca tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:04.442210 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5bb68604-f21b-401b-9851-e6d7d5d9f8ca tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:04.443017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5bb68604-f21b-401b-9851-e6d7d5d9f8ca tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:04.683142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:04.683713 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:04.690425 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:04.690922 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:04.691358 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:04.692591 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:04.693079 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:04.693663 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:04.846801 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:04.859783 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:04.861469 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:04.862742 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a0e40708-d66b-43f3-84c7-c91fa9bda76a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.184271 Aug 24 16:51:04.863471 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 418/842] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:04 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:51:05.808315 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5bb68604-f21b-401b-9851-e6d7d5d9f8ca tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "POST /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.382181 Aug 24 16:51:05.809135 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 425/843] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:51:04 2022] POST /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments => generated 194 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:05.893707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:05.894826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:05.901914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:05.902582 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:05.902852 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:05.903562 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:05.904066 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:05.904531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:06.062337 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:06.077694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:06.080324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:06.083750 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a7ffaa82-cba6-4cdc-b74f-18c38be553d2 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1742 microversion: 2.20 time: 0.199556 Aug 24 16:51:06.084157 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 419/844] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:05 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1742 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:06.099012 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c3eb424e-2f57-417c-ac70-680a586bffea tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:06.099896 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c3eb424e-2f57-417c-ac70-680a586bffea tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:06.110551 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c3eb424e-2f57-417c-ac70-680a586bffea tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:06.111173 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c3eb424e-2f57-417c-ac70-680a586bffea tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:06.111839 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c3eb424e-2f57-417c-ac70-680a586bffea tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:06.113457 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c3eb424e-2f57-417c-ac70-680a586bffea tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:06.113696 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c3eb424e-2f57-417c-ac70-680a586bffea tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:06.114372 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c3eb424e-2f57-417c-ac70-680a586bffea tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:06.153416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c3eb424e-2f57-417c-ac70-680a586bffea tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/ips" status: 200 len: 151 microversion: 2.1 time: 0.061921 Aug 24 16:51:06.154534 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 426/845] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 16:51:06 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/ips => generated 151 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:07.109579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:07.110242 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:07.119877 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:07.120510 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:07.121074 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:07.121975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:07.122435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:07.122860 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:07.282987 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:07.298629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:07.301998 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:07.304603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f4283042-e4a7-4192-acee-c7281d8b4f4e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1742 microversion: 2.20 time: 0.198761 Aug 24 16:51:07.309619 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 420/846] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:07 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1742 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:08.093482 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-eb38f471-0e0f-42f7-8f40-1dba47b16258 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db828523-f167-4c6c-9429-7c836d348809"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:08.097582 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-eb38f471-0e0f-42f7-8f40-1dba47b16258 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:08.106257 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb38f471-0e0f-42f7-8f40-1dba47b16258 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:08.106740 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb38f471-0e0f-42f7-8f40-1dba47b16258 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:08.107173 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb38f471-0e0f-42f7-8f40-1dba47b16258 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:08.107877 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb38f471-0e0f-42f7-8f40-1dba47b16258 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:08.108425 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb38f471-0e0f-42f7-8f40-1dba47b16258 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:08.108827 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb38f471-0e0f-42f7-8f40-1dba47b16258 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:08.344823 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:08.348831 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:08.353186 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:08.353687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:08.354127 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:08.354997 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:08.355517 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:08.355941 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:08.522921 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:08.533774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:08.536477 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:08.538273 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-54e9fe4f-340f-4e2a-ba28-7065ce64bffd tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.198912 Aug 24 16:51:08.550070 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 421/847] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:08 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:09.257641 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-eb38f471-0e0f-42f7-8f40-1dba47b16258 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "POST /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.169352 Aug 24 16:51:09.258260 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 427/848] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:51:08 2022] POST /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments => generated 194 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:09.562394 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:09.562915 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:09.573666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:09.574462 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:09.574903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:09.575617 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:09.576075 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:09.576539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:09.782904 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:09.789331 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:09.796732 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:09.798956 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:09.800385 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6e1a53ba-7492-48df-8892-f20fb81a210f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.241974 Aug 24 16:51:09.833517 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 422/849] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:09 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:10.784584 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-6c7cb1c4-c8e0-4b75-ba98-bd7bfdaeb182 req-ad198734-227f-4b33-adec-273ed09e8014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75145055-cbf0-4840-b4fc-a2907f7b8f1c", "name": "network-vif-plugged", "status": "completed", "tag": "2f2e239d-8035-4f37-96dd-4e4f3002af3d"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:10.814232 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-6c7cb1c4-c8e0-4b75-ba98-bd7bfdaeb182 req-ad198734-227f-4b33-adec-273ed09e8014 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:10.815360 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-6c7cb1c4-c8e0-4b75-ba98-bd7bfdaeb182 req-ad198734-227f-4b33-adec-273ed09e8014 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:10.816089 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-6c7cb1c4-c8e0-4b75-ba98-bd7bfdaeb182 req-ad198734-227f-4b33-adec-273ed09e8014 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:10.831547 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:10.832168 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:10.837102 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-6c7cb1c4-c8e0-4b75-ba98-bd7bfdaeb182 req-ad198734-227f-4b33-adec-273ed09e8014 service nova] Creating event network-vif-plugged:2f2e239d-8035-4f37-96dd-4e4f3002af3d for instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c on hv-cinder-73116 Aug 24 16:51:10.840855 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:10.841332 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:10.841848 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:10.842577 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:10.843111 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:10.843544 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:10.844329 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-6c7cb1c4-c8e0-4b75-ba98-bd7bfdaeb182 req-ad198734-227f-4b33-adec-273ed09e8014 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070859 Aug 24 16:51:10.845659 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 428/850] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:51:11.181029 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:11.194651 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:11.197153 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:11.198891 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-322bbbc2-fd5d-4740-8222-be0d8bb7a889 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.372182 Aug 24 16:51:11.199488 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 423/851] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:10 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:51:12.225705 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:12.226822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:12.238076 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:12.238587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:12.239657 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:12.240945 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:12.241136 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:12.241575 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:12.508784 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:12.553245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:12.565326 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:12.567158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:12.573453 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d54e909a-547e-4594-8acd-7687e5ccbb40 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.353452 Aug 24 16:51:12.587969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 429/852] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:12 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:13.615174 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:13.616523 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:13.634179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:13.636880 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:13.643769 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:13.646705 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:13.650753 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:13.653277 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:13.887262 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e87c97b0-5ad7-42bf-8d16-a626d96159cb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:13.891185 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e87c97b0-5ad7-42bf-8d16-a626d96159cb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:13.900259 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e87c97b0-5ad7-42bf-8d16-a626d96159cb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:13.901940 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e87c97b0-5ad7-42bf-8d16-a626d96159cb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:13.902549 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e87c97b0-5ad7-42bf-8d16-a626d96159cb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:13.903433 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e87c97b0-5ad7-42bf-8d16-a626d96159cb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:13.904053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e87c97b0-5ad7-42bf-8d16-a626d96159cb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:13.904743 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e87c97b0-5ad7-42bf-8d16-a626d96159cb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:13.904892 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:13.914958 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:13.917002 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:13.918535 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5987eb07-608f-463e-9aba-5cce8d6ee944 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.323256 Aug 24 16:51:13.919622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 424/853] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:13 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:13.941746 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e87c97b0-5ad7-42bf-8d16-a626d96159cb tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058678 Aug 24 16:51:13.954753 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 430/854] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:51:13 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:51:14.106293 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b061a773-a9e6-439a-b154-ee772dd731c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:14.106686 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b061a773-a9e6-439a-b154-ee772dd731c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:14.117223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b061a773-a9e6-439a-b154-ee772dd731c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:14.117930 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b061a773-a9e6-439a-b154-ee772dd731c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:14.119491 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b061a773-a9e6-439a-b154-ee772dd731c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:14.121951 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b061a773-a9e6-439a-b154-ee772dd731c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:14.122430 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b061a773-a9e6-439a-b154-ee772dd731c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:14.122864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b061a773-a9e6-439a-b154-ee772dd731c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:14.162766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b061a773-a9e6-439a-b154-ee772dd731c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments/28f255a5-0e36-4827-b20d-df00fca2a98e" status: 200 len: 194 microversion: 2.1 time: 0.060529 Aug 24 16:51:14.163976 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 425/855] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Aug 24 16:51:14 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments/28f255a5-0e36-4827-b20d-df00fca2a98e => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:14.186422 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ec6ea6e4-cbd6-46f6-b5b5-71245423fb67 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:14.187782 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ec6ea6e4-cbd6-46f6-b5b5-71245423fb67 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:14.199187 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ec6ea6e4-cbd6-46f6-b5b5-71245423fb67 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:14.200465 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ec6ea6e4-cbd6-46f6-b5b5-71245423fb67 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:14.201343 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ec6ea6e4-cbd6-46f6-b5b5-71245423fb67 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:14.203390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ec6ea6e4-cbd6-46f6-b5b5-71245423fb67 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:14.204163 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ec6ea6e4-cbd6-46f6-b5b5-71245423fb67 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:14.205299 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ec6ea6e4-cbd6-46f6-b5b5-71245423fb67 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:14.354553 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-ec6ea6e4-cbd6-46f6-b5b5-71245423fb67 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lazy-loading 'services' on Instance uuid 09b9c747-048e-4478-b065-0bd606ea331a {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:51:14.614427 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ec6ea6e4-cbd6-46f6-b5b5-71245423fb67 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "DELETE /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments/28f255a5-0e36-4827-b20d-df00fca2a98e" status: 202 len: 0 microversion: 2.1 time: 0.436033 Aug 24 16:51:14.615293 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 431/856] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:51:14 2022] DELETE /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments/28f255a5-0e36-4827-b20d-df00fca2a98e => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:51:14.952382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:14.954093 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:14.961960 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:14.962836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:14.963689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:14.965816 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:14.966655 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:14.967636 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:15.187875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:15.204449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:15.207250 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:15.210045 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a11ba4cd-652b-48b2-ae6b-09c48dba09e7 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.261409 Aug 24 16:51:15.227092 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 426/857] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:14 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:16.245794 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:16.247206 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:16.256851 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:16.257645 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:16.258391 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:16.259472 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:16.260114 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:16.260768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:16.458042 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:16.470306 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:16.471946 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:16.473339 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f6d1cc7f-5fa0-424d-821a-98a12c4aff05 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.232339 Aug 24 16:51:16.475037 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 432/858] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:16 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:17.501006 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:17.501633 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:17.510055 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:17.511276 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:17.511905 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:17.512922 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:17.513562 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:17.514164 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:17.689319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:17.702183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:17.704978 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:17.706939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b1bdc67d-ffc5-4841-bee0-d8bf35edc00e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.210075 Aug 24 16:51:17.707690 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 427/859] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:17 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:18.735340 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:18.742379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:18.746578 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:18.747386 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:18.748000 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:18.748986 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:18.749611 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:18.751146 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:18.959143 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:18.969968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:18.977260 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:18.981863 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c2f1ac2e-00a6-4b1f-990d-6ce3fb59265f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.253473 Aug 24 16:51:18.985352 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 433/860] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:18 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:20.009876 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:20.012592 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:20.020782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=41 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:20.023031 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:20.023619 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:20.024136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:20.025153 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:20.025829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:20.026478 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:20.302038 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:20.321929 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:20.327589 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:20.327589 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8c922cbe-b042-434e-a436-d0fd31cc35de tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.322783 Aug 24 16:51:20.338570 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 428/861] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:20 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:21.355775 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:21.356464 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:21.359017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=37 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:21.366978 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:21.367693 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:21.368200 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:21.368995 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:21.369457 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:21.369894 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:21.631592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:21.642080 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:21.644165 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:21.646460 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d2daabba-7535-48f6-82c9-79ee8e2e6df6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.293961 Aug 24 16:51:21.647292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 434/862] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:21 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:51:22.684331 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:22.685215 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:22.692104 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:22.692692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:22.693188 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:22.693886 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:22.694343 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:22.694765 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:23.031722 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:23.040995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:23.042717 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:23.043955 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-352cccf4-89f4-43e8-bbda-11cd0ba18899 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1737 microversion: 2.20 time: 0.363722 Aug 24 16:51:23.044963 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 429/863] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:22 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1737 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:23.088225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1605f37a-2ca1-4b00-8a64-fb894fb8d8ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:23.088840 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1605f37a-2ca1-4b00-8a64-fb894fb8d8ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:23.095406 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1605f37a-2ca1-4b00-8a64-fb894fb8d8ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:23.095903 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1605f37a-2ca1-4b00-8a64-fb894fb8d8ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:23.096565 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1605f37a-2ca1-4b00-8a64-fb894fb8d8ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:23.102587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1605f37a-2ca1-4b00-8a64-fb894fb8d8ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:23.102587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1605f37a-2ca1-4b00-8a64-fb894fb8d8ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:23.102587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1605f37a-2ca1-4b00-8a64-fb894fb8d8ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:23.216744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-1605f37a-2ca1-4b00-8a64-fb894fb8d8ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lazy-loading 'services' on Instance uuid 5fdefed9-549e-4154-9e78-a9d762019d38 {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:51:23.402716 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b4fcc507-8fee-426c-b667-5bb16028f75b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:23.403212 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b4fcc507-8fee-426c-b667-5bb16028f75b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:23.409499 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b4fcc507-8fee-426c-b667-5bb16028f75b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:23.409984 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b4fcc507-8fee-426c-b667-5bb16028f75b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:23.410420 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b4fcc507-8fee-426c-b667-5bb16028f75b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:23.411710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b4fcc507-8fee-426c-b667-5bb16028f75b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:23.412219 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b4fcc507-8fee-426c-b667-5bb16028f75b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:23.412828 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b4fcc507-8fee-426c-b667-5bb16028f75b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:23.444923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b4fcc507-8fee-426c-b667-5bb16028f75b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments/27b415f5-4d38-4056-9c1f-af39e6cd22a7" status: 200 len: 194 microversion: 2.1 time: 0.046216 Aug 24 16:51:23.445532 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 430/864] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Aug 24 16:51:23 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments/27b415f5-4d38-4056-9c1f-af39e6cd22a7 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:51:23.458252 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ec6c4384-4dad-4264-a5fe-ed9ac42b8972 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:23.458823 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ec6c4384-4dad-4264-a5fe-ed9ac42b8972 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:23.467974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec6c4384-4dad-4264-a5fe-ed9ac42b8972 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:23.468650 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec6c4384-4dad-4264-a5fe-ed9ac42b8972 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:23.469089 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec6c4384-4dad-4264-a5fe-ed9ac42b8972 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:23.469812 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec6c4384-4dad-4264-a5fe-ed9ac42b8972 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:23.470299 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec6c4384-4dad-4264-a5fe-ed9ac42b8972 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:23.470739 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec6c4384-4dad-4264-a5fe-ed9ac42b8972 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:23.563709 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-ec6c4384-4dad-4264-a5fe-ed9ac42b8972 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lazy-loading 'services' on Instance uuid 09b9c747-048e-4478-b065-0bd606ea331a {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:51:23.576430 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1605f37a-2ca1-4b00-8a64-fb894fb8d8ad tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments/db828523-f167-4c6c-9429-7c836d348809" status: 202 len: 0 microversion: 2.1 time: 0.492617 Aug 24 16:51:23.584461 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 435/865] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:51:23 2022] DELETE /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments/db828523-f167-4c6c-9429-7c836d348809 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:51:23.587517 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-334bf581-a3ec-43ec-ab5d-aafcd3629c37 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:23.590200 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-334bf581-a3ec-43ec-ab5d-aafcd3629c37 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:23.597953 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-334bf581-a3ec-43ec-ab5d-aafcd3629c37 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:23.598456 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-334bf581-a3ec-43ec-ab5d-aafcd3629c37 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:23.599664 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-334bf581-a3ec-43ec-ab5d-aafcd3629c37 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:23.600398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-334bf581-a3ec-43ec-ab5d-aafcd3629c37 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:23.600857 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-334bf581-a3ec-43ec-ab5d-aafcd3629c37 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:23.601276 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-334bf581-a3ec-43ec-ab5d-aafcd3629c37 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:23.635129 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-334bf581-a3ec-43ec-ab5d-aafcd3629c37 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053154 Aug 24 16:51:23.635733 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 436/866] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:51:23 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:51:24.013710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ec6c4384-4dad-4264-a5fe-ed9ac42b8972 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "DELETE /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments/27b415f5-4d38-4056-9c1f-af39e6cd22a7" status: 202 len: 0 microversion: 2.1 time: 0.560033 Aug 24 16:51:24.014434 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 431/867] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:51:23 2022] DELETE /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments/27b415f5-4d38-4056-9c1f-af39e6cd22a7 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 16:51:24.070541 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:24.071167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:24.077511 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:24.079240 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:24.079240 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:24.079240 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:24.079735 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:24.080107 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:24.235448 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:24.245435 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:24.247074 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:24.248309 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3db8fd67-420e-4a44-a17d-bf92f61f6633 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1719 microversion: 2.20 time: 0.183036 Aug 24 16:51:24.248912 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 437/868] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:24 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:24.649537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-74e27ab8-6808-4734-9e2b-f43025f08886 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:24.651984 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-74e27ab8-6808-4734-9e2b-f43025f08886 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:24.658524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74e27ab8-6808-4734-9e2b-f43025f08886 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:24.659006 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74e27ab8-6808-4734-9e2b-f43025f08886 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:24.659433 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74e27ab8-6808-4734-9e2b-f43025f08886 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:24.660134 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74e27ab8-6808-4734-9e2b-f43025f08886 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:24.660607 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74e27ab8-6808-4734-9e2b-f43025f08886 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:24.661033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74e27ab8-6808-4734-9e2b-f43025f08886 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:24.697835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-74e27ab8-6808-4734-9e2b-f43025f08886 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054048 Aug 24 16:51:24.698331 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 432/869] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:51:24 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:25.277466 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:25.278058 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:25.284720 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:25.285231 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:25.285661 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:25.286387 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:25.286840 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:25.287260 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:25.597483 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:25.606410 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:25.607898 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:25.609070 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-4a04639e-f997-48c6-a5db-c8a84838a330 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1719 microversion: 2.20 time: 0.335700 Aug 24 16:51:25.609624 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 438/870] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:25 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1719 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:25.710341 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-670639b3-fb3c-4839-bf6e-65c5f9e4cd9a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:25.712558 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-670639b3-fb3c-4839-bf6e-65c5f9e4cd9a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:25.719312 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-670639b3-fb3c-4839-bf6e-65c5f9e4cd9a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:25.719821 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-670639b3-fb3c-4839-bf6e-65c5f9e4cd9a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:25.720224 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-670639b3-fb3c-4839-bf6e-65c5f9e4cd9a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:25.720955 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-670639b3-fb3c-4839-bf6e-65c5f9e4cd9a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:25.721405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-670639b3-fb3c-4839-bf6e-65c5f9e4cd9a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:25.721821 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-670639b3-fb3c-4839-bf6e-65c5f9e4cd9a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:25.752496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-670639b3-fb3c-4839-bf6e-65c5f9e4cd9a tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 Aug 24 16:51:25.753050 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 433/871] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:51:25 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:26.632672 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-eead64ac-1376-4779-b32a-f4967493f453 req-b6abbd1e-c57b-4f63-be43-affce9ddd316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75145055-cbf0-4840-b4fc-a2907f7b8f1c", "name": "network-vif-unplugged", "status": "completed", "tag": "2f2e239d-8035-4f37-96dd-4e4f3002af3d"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:26.643794 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-eead64ac-1376-4779-b32a-f4967493f453 req-b6abbd1e-c57b-4f63-be43-affce9ddd316 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:26.644278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-eead64ac-1376-4779-b32a-f4967493f453 req-b6abbd1e-c57b-4f63-be43-affce9ddd316 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:26.644822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-eead64ac-1376-4779-b32a-f4967493f453 req-b6abbd1e-c57b-4f63-be43-affce9ddd316 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:26.646852 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:26.648070 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:26.656103 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:26.656638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:26.657074 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:26.657465 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-eead64ac-1376-4779-b32a-f4967493f453 req-b6abbd1e-c57b-4f63-be43-affce9ddd316 service nova] Creating event network-vif-unplugged:2f2e239d-8035-4f37-96dd-4e4f3002af3d for instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c on hv-cinder-73116 Aug 24 16:51:26.657781 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:26.658237 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:26.658672 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:26.663718 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-eead64ac-1376-4779-b32a-f4967493f453 req-b6abbd1e-c57b-4f63-be43-affce9ddd316 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034912 Aug 24 16:51:26.677022 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 439/872] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:26.765471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a5c4f81a-4b4f-4753-8844-7f28e50d36ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:26.767845 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a5c4f81a-4b4f-4753-8844-7f28e50d36ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:26.775105 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a5c4f81a-4b4f-4753-8844-7f28e50d36ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:26.775659 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a5c4f81a-4b4f-4753-8844-7f28e50d36ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:26.776160 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a5c4f81a-4b4f-4753-8844-7f28e50d36ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:26.776963 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a5c4f81a-4b4f-4753-8844-7f28e50d36ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:26.777481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a5c4f81a-4b4f-4753-8844-7f28e50d36ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:26.777965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a5c4f81a-4b4f-4753-8844-7f28e50d36ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:26.809884 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a5c4f81a-4b4f-4753-8844-7f28e50d36ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048645 Aug 24 16:51:26.810493 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 440/873] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:51:26 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:51:26.826020 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:26.835948 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:26.837500 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:26.838735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bc117e71-3435-41e4-abb5-cb0a32aa48d8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1719 microversion: 2.20 time: 0.200971 Aug 24 16:51:26.839309 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 434/874] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:26 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:51:27.822923 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-84666696-aab6-419f-9863-742af0b3919f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:27.825116 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-84666696-aab6-419f-9863-742af0b3919f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:27.831693 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-84666696-aab6-419f-9863-742af0b3919f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:27.832186 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-84666696-aab6-419f-9863-742af0b3919f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:27.832671 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-84666696-aab6-419f-9863-742af0b3919f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:27.833388 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-84666696-aab6-419f-9863-742af0b3919f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:27.834039 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-84666696-aab6-419f-9863-742af0b3919f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:27.834467 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-84666696-aab6-419f-9863-742af0b3919f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:27.863798 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:27.865236 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:27.872478 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:27.873368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:27.873851 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:27.874620 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:27.875155 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:27.875506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-84666696-aab6-419f-9863-742af0b3919f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056841 Aug 24 16:51:27.875706 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:27.880516 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 441/875] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:51:27 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:51:28.016005 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:28.024691 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:28.026131 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:28.027307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d3dfba46-7a79-4a54-be41-c7a8af9be817 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1719 microversion: 2.20 time: 0.168600 Aug 24 16:51:28.027860 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 435/876] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:27 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:28.888606 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a9197e25-5e31-4d5c-8187-cf6504726aaa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:28.891397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a9197e25-5e31-4d5c-8187-cf6504726aaa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:28.898594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a9197e25-5e31-4d5c-8187-cf6504726aaa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:28.899156 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a9197e25-5e31-4d5c-8187-cf6504726aaa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:28.899823 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a9197e25-5e31-4d5c-8187-cf6504726aaa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:28.901004 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a9197e25-5e31-4d5c-8187-cf6504726aaa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:28.901260 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a9197e25-5e31-4d5c-8187-cf6504726aaa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:28.901689 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a9197e25-5e31-4d5c-8187-cf6504726aaa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:28.934599 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a9197e25-5e31-4d5c-8187-cf6504726aaa tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050419 Aug 24 16:51:28.935173 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 442/877] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:51:28 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:51:29.052960 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:29.053914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:29.075514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:29.075514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:29.075514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:29.075514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:29.076220 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:29.076220 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:29.225223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:29.225223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:29.226038 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:29.227250 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f8b61ffa-d0a0-493a-9048-dba41ee56670 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1719 microversion: 2.20 time: 0.179585 Aug 24 16:51:29.227826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 436/878] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:29 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:29.947663 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0cbe714f-0a41-4fe2-a6e8-379a439171fe tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:29.949872 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0cbe714f-0a41-4fe2-a6e8-379a439171fe tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:29.956597 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0cbe714f-0a41-4fe2-a6e8-379a439171fe tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:29.957010 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0cbe714f-0a41-4fe2-a6e8-379a439171fe tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:29.957443 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0cbe714f-0a41-4fe2-a6e8-379a439171fe tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:29.958336 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0cbe714f-0a41-4fe2-a6e8-379a439171fe tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:29.958783 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0cbe714f-0a41-4fe2-a6e8-379a439171fe tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:29.959199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0cbe714f-0a41-4fe2-a6e8-379a439171fe tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:29.992191 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0cbe714f-0a41-4fe2-a6e8-379a439171fe tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049347 Aug 24 16:51:29.992797 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 443/879] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:51:29 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:51:30.066396 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9c2c0fa3-b9c9-4d2d-ae01-74f1966b9cc1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:30.068974 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9c2c0fa3-b9c9-4d2d-ae01-74f1966b9cc1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:30.073730 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2c0fa3-b9c9-4d2d-ae01-74f1966b9cc1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:30.074221 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2c0fa3-b9c9-4d2d-ae01-74f1966b9cc1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:30.074667 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2c0fa3-b9c9-4d2d-ae01-74f1966b9cc1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:30.075584 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2c0fa3-b9c9-4d2d-ae01-74f1966b9cc1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:30.076042 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2c0fa3-b9c9-4d2d-ae01-74f1966b9cc1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:30.076511 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9c2c0fa3-b9c9-4d2d-ae01-74f1966b9cc1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:30.102987 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9c2c0fa3-b9c9-4d2d-ae01-74f1966b9cc1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:51:30.140521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:30.253633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:30.254286 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:30.262089 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:30.262579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:30.263003 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:30.263691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:30.264134 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:30.264591 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:30.412950 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:30.422000 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:30.423572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:30.424822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3552a54a-a1fd-40d0-961b-c7becd0d3c6c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1722 microversion: 2.20 time: 0.176791 Aug 24 16:51:30.425400 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 444/880] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:30 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:51:30.448483 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-25ced3cb-dd84-4273-adda-ac005bea8f0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bbe637a-4ad3-4890-9fd8-fdb4c1f3ab2f"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:30.450940 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-25ced3cb-dd84-4273-adda-ac005bea8f0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:30.456991 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25ced3cb-dd84-4273-adda-ac005bea8f0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:30.457480 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25ced3cb-dd84-4273-adda-ac005bea8f0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:30.457919 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25ced3cb-dd84-4273-adda-ac005bea8f0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:30.459839 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25ced3cb-dd84-4273-adda-ac005bea8f0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:30.460300 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25ced3cb-dd84-4273-adda-ac005bea8f0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:30.460767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25ced3cb-dd84-4273-adda-ac005bea8f0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:30.543424 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:30.947835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9c2c0fa3-b9c9-4d2d-ae01-74f1966b9cc1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 204 len: 0 microversion: 2.1 time: 0.884970 Aug 24 16:51:30.948897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 437/881] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:51:30 2022] DELETE /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:51:30.956556 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9034f056-a7d4-4bcc-9c4b-d51c9e172dc6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:30.959515 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9034f056-a7d4-4bcc-9c4b-d51c9e172dc6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:30.966316 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9034f056-a7d4-4bcc-9c4b-d51c9e172dc6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:30.966798 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9034f056-a7d4-4bcc-9c4b-d51c9e172dc6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:30.967428 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9034f056-a7d4-4bcc-9c4b-d51c9e172dc6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:30.968281 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9034f056-a7d4-4bcc-9c4b-d51c9e172dc6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:30.968838 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9034f056-a7d4-4bcc-9c4b-d51c9e172dc6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:30.969312 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9034f056-a7d4-4bcc-9c4b-d51c9e172dc6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:30.999644 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9034f056-a7d4-4bcc-9c4b-d51c9e172dc6 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049169 Aug 24 16:51:31.000191 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 438/882] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:51:30 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:51:31.006371 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6c728e6d-3b91-40bc-9f3e-1baf5655ed9e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:31.006979 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6c728e6d-3b91-40bc-9f3e-1baf5655ed9e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:31.012866 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c728e6d-3b91-40bc-9f3e-1baf5655ed9e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:31.013346 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c728e6d-3b91-40bc-9f3e-1baf5655ed9e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:31.013777 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c728e6d-3b91-40bc-9f3e-1baf5655ed9e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:31.014462 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c728e6d-3b91-40bc-9f3e-1baf5655ed9e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:31.014910 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c728e6d-3b91-40bc-9f3e-1baf5655ed9e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:31.015370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c728e6d-3b91-40bc-9f3e-1baf5655ed9e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:31.159598 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6c728e6d-3b91-40bc-9f3e-1baf5655ed9e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:31.169547 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6c728e6d-3b91-40bc-9f3e-1baf5655ed9e tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1683 microversion: 2.1 time: 0.168352 Aug 24 16:51:31.170128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 439/883] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:31 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:31.174680 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fda43e4b-b861-4eb9-b479-beffe3b2c6ed tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:31.177028 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fda43e4b-b861-4eb9-b479-beffe3b2c6ed tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:31.184059 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fda43e4b-b861-4eb9-b479-beffe3b2c6ed tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:31.184585 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fda43e4b-b861-4eb9-b479-beffe3b2c6ed tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:31.185026 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fda43e4b-b861-4eb9-b479-beffe3b2c6ed tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:31.185734 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fda43e4b-b861-4eb9-b479-beffe3b2c6ed tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:31.186192 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fda43e4b-b861-4eb9-b479-beffe3b2c6ed tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:31.186620 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fda43e4b-b861-4eb9-b479-beffe3b2c6ed tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:31.220189 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fda43e4b-b861-4eb9-b479-beffe3b2c6ed tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049025 Aug 24 16:51:31.220779 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 440/884] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 16:51:31 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:51:31.528135 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-69bc9f1d-6787-4070-abbe-4532870493b9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:31.528658 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-69bc9f1d-6787-4070-abbe-4532870493b9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:31.534805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69bc9f1d-6787-4070-abbe-4532870493b9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:31.535294 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69bc9f1d-6787-4070-abbe-4532870493b9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:31.535732 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69bc9f1d-6787-4070-abbe-4532870493b9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:31.536623 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69bc9f1d-6787-4070-abbe-4532870493b9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:31.536934 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69bc9f1d-6787-4070-abbe-4532870493b9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:31.537484 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69bc9f1d-6787-4070-abbe-4532870493b9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:31.564206 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-69bc9f1d-6787-4070-abbe-4532870493b9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:51:31.930831 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-69bc9f1d-6787-4070-abbe-4532870493b9 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "DELETE /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 204 len: 0 microversion: 2.1 time: 0.406309 Aug 24 16:51:31.931427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 441/885] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:51:31 2022] DELETE /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:51:31.939931 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1381ef79-075b-465b-8b69-372128812d9c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:31.945237 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1381ef79-075b-465b-8b69-372128812d9c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:31.947423 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1381ef79-075b-465b-8b69-372128812d9c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:31.947910 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1381ef79-075b-465b-8b69-372128812d9c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:31.948368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1381ef79-075b-465b-8b69-372128812d9c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:31.949082 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1381ef79-075b-465b-8b69-372128812d9c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:31.949538 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1381ef79-075b-465b-8b69-372128812d9c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:31.949957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1381ef79-075b-465b-8b69-372128812d9c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:32.101897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1381ef79-075b-465b-8b69-372128812d9c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:32.113566 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1381ef79-075b-465b-8b69-372128812d9c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1675 microversion: 2.1 time: 0.177516 Aug 24 16:51:32.115208 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 442/886] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:31 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:51:32.181746 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-25ced3cb-dd84-4273-adda-ac005bea8f0c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "POST /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.737257 Aug 24 16:51:32.182729 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 445/887] 10.222.0.17 () {62 vars in 1364 bytes} [Wed Aug 24 16:51:30 2022] POST /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/os-volume_attachments => generated 188 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:51:32.191188 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-68475da4-0b0f-42c9-8f52-e0a922f7c37c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:32.191800 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-68475da4-0b0f-42c9-8f52-e0a922f7c37c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:32.200111 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68475da4-0b0f-42c9-8f52-e0a922f7c37c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:32.200689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68475da4-0b0f-42c9-8f52-e0a922f7c37c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:32.201180 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68475da4-0b0f-42c9-8f52-e0a922f7c37c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:32.201983 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68475da4-0b0f-42c9-8f52-e0a922f7c37c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:32.202511 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68475da4-0b0f-42c9-8f52-e0a922f7c37c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:32.202942 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68475da4-0b0f-42c9-8f52-e0a922f7c37c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:32.340093 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-068bc6f8-aaa9-432b-8694-d71638e39cc4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:32.340665 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-068bc6f8-aaa9-432b-8694-d71638e39cc4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:32.347801 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-068bc6f8-aaa9-432b-8694-d71638e39cc4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:32.348872 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-068bc6f8-aaa9-432b-8694-d71638e39cc4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:32.349287 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-068bc6f8-aaa9-432b-8694-d71638e39cc4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:32.349759 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-068bc6f8-aaa9-432b-8694-d71638e39cc4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:32.350122 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-068bc6f8-aaa9-432b-8694-d71638e39cc4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:32.350611 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-068bc6f8-aaa9-432b-8694-d71638e39cc4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:32.366584 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-68475da4-0b0f-42c9-8f52-e0a922f7c37c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:32.375084 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-68475da4-0b0f-42c9-8f52-e0a922f7c37c tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1683 microversion: 2.1 time: 0.187877 Aug 24 16:51:32.375701 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 443/888] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:32 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:33.123659 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-068bc6f8-aaa9-432b-8694-d71638e39cc4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/os-volume_attachments/8bbe637a-4ad3-4890-9fd8-fdb4c1f3ab2f" status: 202 len: 0 microversion: 2.20 time: 0.787807 Aug 24 16:51:33.124301 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 446/889] 10.222.0.17 () {60 vars in 1457 bytes} [Wed Aug 24 16:51:32 2022] DELETE /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/os-volume_attachments/8bbe637a-4ad3-4890-9fd8-fdb4c1f3ab2f => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:51:33.137359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dae7ffca-a5f2-4706-9dd2-e4c3be724c65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:33.138021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-dae7ffca-a5f2-4706-9dd2-e4c3be724c65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:33.146333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae7ffca-a5f2-4706-9dd2-e4c3be724c65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:33.146333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae7ffca-a5f2-4706-9dd2-e4c3be724c65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:33.146333 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae7ffca-a5f2-4706-9dd2-e4c3be724c65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:33.146994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae7ffca-a5f2-4706-9dd2-e4c3be724c65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:33.147546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae7ffca-a5f2-4706-9dd2-e4c3be724c65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:33.147985 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dae7ffca-a5f2-4706-9dd2-e4c3be724c65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:33.192670 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-de3f5a9f-f336-42ab-aa25-04406ff7d46d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:33.193358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-de3f5a9f-f336-42ab-aa25-04406ff7d46d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:33.200139 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de3f5a9f-f336-42ab-aa25-04406ff7d46d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:33.200716 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de3f5a9f-f336-42ab-aa25-04406ff7d46d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:33.201164 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de3f5a9f-f336-42ab-aa25-04406ff7d46d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:33.201868 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de3f5a9f-f336-42ab-aa25-04406ff7d46d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:33.202322 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de3f5a9f-f336-42ab-aa25-04406ff7d46d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:33.202744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-de3f5a9f-f336-42ab-aa25-04406ff7d46d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:33.232869 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-de3f5a9f-f336-42ab-aa25-04406ff7d46d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127626) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 16:51:33.313754 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-dae7ffca-a5f2-4706-9dd2-e4c3be724c65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:33.322837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-dae7ffca-a5f2-4706-9dd2-e4c3be724c65 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1675 microversion: 2.1 time: 0.190352 Aug 24 16:51:33.323812 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 444/890] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:33 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:33.398674 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-32e69111-ae1c-4226-a90f-336931bc4026 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:33.399207 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-32e69111-ae1c-4226-a90f-336931bc4026 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:33.405282 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e69111-ae1c-4226-a90f-336931bc4026 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:33.405766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e69111-ae1c-4226-a90f-336931bc4026 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:33.406205 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e69111-ae1c-4226-a90f-336931bc4026 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:33.406907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e69111-ae1c-4226-a90f-336931bc4026 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:33.407384 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e69111-ae1c-4226-a90f-336931bc4026 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:33.407862 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e69111-ae1c-4226-a90f-336931bc4026 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:33.547676 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-32e69111-ae1c-4226-a90f-336931bc4026 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:33.555629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-32e69111-ae1c-4226-a90f-336931bc4026 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1683 microversion: 2.1 time: 0.161896 Aug 24 16:51:33.556232 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 445/891] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:33 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:51:33.713418 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-de3f5a9f-f336-42ab-aa25-04406ff7d46d tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "POST /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/action" status: 202 len: 0 microversion: 2.20 time: 0.524890 Aug 24 16:51:33.718484 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 447/892] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 24 16:51:33 2022] POST /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:51:33.722555 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:33.723251 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:33.731103 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:33.731739 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:33.732179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:33.732919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:33.733402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:33.733828 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:33.984303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:33.993890 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:33.995560 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:33.996875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7bef3196-990e-4e0f-b9f5-0fe62b8f358e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1670 microversion: 2.20 time: 0.278448 Aug 24 16:51:33.997519 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 446/893] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:33 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1670 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:34.355133 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c7db2bda-893e-4bb5-abc5-9fd8af202806 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:34.356755 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c7db2bda-893e-4bb5-abc5-9fd8af202806 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:34.363282 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7db2bda-893e-4bb5-abc5-9fd8af202806 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:34.364086 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7db2bda-893e-4bb5-abc5-9fd8af202806 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:34.365088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7db2bda-893e-4bb5-abc5-9fd8af202806 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:34.366121 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7db2bda-893e-4bb5-abc5-9fd8af202806 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:34.366820 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7db2bda-893e-4bb5-abc5-9fd8af202806 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:34.367339 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7db2bda-893e-4bb5-abc5-9fd8af202806 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:34.577402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cc23ff0f-e02f-4f7a-bc3d-2dba4fe424e1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:34.578022 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cc23ff0f-e02f-4f7a-bc3d-2dba4fe424e1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:34.584872 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc23ff0f-e02f-4f7a-bc3d-2dba4fe424e1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:34.585469 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc23ff0f-e02f-4f7a-bc3d-2dba4fe424e1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:34.585970 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc23ff0f-e02f-4f7a-bc3d-2dba4fe424e1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:34.586773 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc23ff0f-e02f-4f7a-bc3d-2dba4fe424e1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:34.587287 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc23ff0f-e02f-4f7a-bc3d-2dba4fe424e1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:34.587818 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc23ff0f-e02f-4f7a-bc3d-2dba4fe424e1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:34.946702 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c7db2bda-893e-4bb5-abc5-9fd8af202806 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:34.955261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c7db2bda-893e-4bb5-abc5-9fd8af202806 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1675 microversion: 2.1 time: 0.604628 Aug 24 16:51:34.956719 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 448/894] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:34 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1675 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:35.021485 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:35.022013 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:35.028308 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:35.028823 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:35.029255 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:35.030031 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:35.030557 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:35.030972 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:35.049485 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cc23ff0f-e02f-4f7a-bc3d-2dba4fe424e1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:35.063249 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cc23ff0f-e02f-4f7a-bc3d-2dba4fe424e1 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1683 microversion: 2.1 time: 0.489593 Aug 24 16:51:35.063979 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 447/895] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:34 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1683 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:51:35.358078 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:35.368303 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:35.373622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:35.373622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-5c963e3a-7664-4f8e-87e4-290efd907b4c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1670 microversion: 2.20 time: 0.353930 Aug 24 16:51:35.373622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 449/896] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:35 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1670 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:51:35.980404 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3d885015-6910-466e-8ba4-36da05f0562a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:35.982662 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3d885015-6910-466e-8ba4-36da05f0562a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:35.994320 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d885015-6910-466e-8ba4-36da05f0562a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:35.994876 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d885015-6910-466e-8ba4-36da05f0562a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:35.995313 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d885015-6910-466e-8ba4-36da05f0562a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:36.001490 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d885015-6910-466e-8ba4-36da05f0562a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:36.001830 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-c10eeb84-2959-4674-a0ff-f2c53b3fba02 req-af30e26f-1824-4de4-8f7a-5af897b8a156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdefed9-549e-4154-9e78-a9d762019d38", "name": "network-vif-deleted", "tag": "186654be-fd06-4d31-aea4-c35029b08980"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:36.004383 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d885015-6910-466e-8ba4-36da05f0562a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:36.005716 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d885015-6910-466e-8ba4-36da05f0562a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:36.023541 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-c10eeb84-2959-4674-a0ff-f2c53b3fba02 req-af30e26f-1824-4de4-8f7a-5af897b8a156 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:36.024165 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-c10eeb84-2959-4674-a0ff-f2c53b3fba02 req-af30e26f-1824-4de4-8f7a-5af897b8a156 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:36.025881 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-c10eeb84-2959-4674-a0ff-f2c53b3fba02 req-af30e26f-1824-4de4-8f7a-5af897b8a156 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:36.052400 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-c10eeb84-2959-4674-a0ff-f2c53b3fba02 req-af30e26f-1824-4de4-8f7a-5af897b8a156 service nova] Creating event network-vif-deleted:186654be-fd06-4d31-aea4-c35029b08980 for instance 5fdefed9-549e-4154-9e78-a9d762019d38 on hv-cinder-73116 Aug 24 16:51:36.063669 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-c10eeb84-2959-4674-a0ff-f2c53b3fba02 req-af30e26f-1824-4de4-8f7a-5af897b8a156 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065585 Aug 24 16:51:36.065908 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 450/897] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:51:36.098473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c7d0565e-78c6-4d4b-937d-d8d8683c1e2f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:36.099701 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c7d0565e-78c6-4d4b-937d-d8d8683c1e2f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:36.108588 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7d0565e-78c6-4d4b-937d-d8d8683c1e2f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:36.109840 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7d0565e-78c6-4d4b-937d-d8d8683c1e2f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:36.110544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7d0565e-78c6-4d4b-937d-d8d8683c1e2f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:36.111523 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7d0565e-78c6-4d4b-937d-d8d8683c1e2f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:36.112239 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7d0565e-78c6-4d4b-937d-d8d8683c1e2f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:36.112977 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7d0565e-78c6-4d4b-937d-d8d8683c1e2f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:36.290249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c7d0565e-78c6-4d4b-937d-d8d8683c1e2f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:36.306125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c7d0565e-78c6-4d4b-937d-d8d8683c1e2f tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1615 microversion: 2.1 time: 0.218276 Aug 24 16:51:36.307277 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3d885015-6910-466e-8ba4-36da05f0562a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:36.315780 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3d885015-6910-466e-8ba4-36da05f0562a tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1607 microversion: 2.1 time: 0.339345 Aug 24 16:51:36.320953 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 451/898] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:36 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1615 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:36.330659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 448/899] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:35 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1607 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:36.400194 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:36.401300 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:36.410195 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:36.410813 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:36.411452 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:36.412294 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:36.412927 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:36.413456 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:36.628717 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:36.638127 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:36.647891 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:36.649512 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e75c94c9-22ef-460a-aa21-2293731af86a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1672 microversion: 2.20 time: 0.258154 Aug 24 16:51:36.650616 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 452/900] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:36 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1672 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:51:37.348980 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:37.350882 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:37.351559 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:37.352168 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:37.363260 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:37.364904 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:37.366078 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:37.370930 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:37.370930 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:37.370930 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:37.371556 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:37.371556 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:37.371556 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:37.371556 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:37.371931 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:37.371931 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:37.414195 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:37.414784 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:37.415120 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:37.415553 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lazy-loading 'fault' on Instance uuid 09b9c747-048e-4478-b065-0bd606ea331a {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:51:37.418281 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:37.418830 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:37.419270 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:37.419725 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lazy-loading 'fault' on Instance uuid 5fdefed9-549e-4154-9e78-a9d762019d38 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:51:37.558401 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9f7755863d45bfb04a1498bd62e367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af535d51fd345f8a9584cc6aaa38bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:37.563575 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce12f8401f3479ba14e5e1c3133a71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71890b7a23944ee939c4bd13408063f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:37.583311 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e7ec40dc-bd81-4a9d-86a3-475f4a2c835b tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 200 len: 1328 microversion: 2.1 time: 0.236973 Aug 24 16:51:37.584226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 453/901] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:37 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 1328 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:51:37.593338 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4011c271-897d-4887-987e-81128f01832d tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 200 len: 1331 microversion: 2.1 time: 0.248627 Aug 24 16:51:37.593884 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 449/902] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:37 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 1331 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:37.675909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:37.679467 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:37.716160 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:37.733330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:37.733330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:37.733330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:37.733743 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:37.734437 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:37.981263 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:37.996008 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:37.997963 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:37.999282 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-fd8632c9-15c9-4d19-bf5e-9d61a9a50051 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.328290 Aug 24 16:51:37.999933 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 454/903] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:37 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:38.086984 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-c6bb99cf-017e-43c7-a7cd-0693bc569592 req-bb4e3693-0523-4035-a953-6c5120129456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b9c747-048e-4478-b065-0bd606ea331a", "name": "network-vif-deleted", "tag": "01448d18-9692-445d-a2e1-37cc9a89b059"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:38.097228 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-c6bb99cf-017e-43c7-a7cd-0693bc569592 req-bb4e3693-0523-4035-a953-6c5120129456 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:38.097711 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-c6bb99cf-017e-43c7-a7cd-0693bc569592 req-bb4e3693-0523-4035-a953-6c5120129456 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:38.098196 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-c6bb99cf-017e-43c7-a7cd-0693bc569592 req-bb4e3693-0523-4035-a953-6c5120129456 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:38.111177 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-c6bb99cf-017e-43c7-a7cd-0693bc569592 req-bb4e3693-0523-4035-a953-6c5120129456 service nova] Creating event network-vif-deleted:01448d18-9692-445d-a2e1-37cc9a89b059 for instance 09b9c747-048e-4478-b065-0bd606ea331a on hv-cinder-73116 Aug 24 16:51:38.117880 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-c6bb99cf-017e-43c7-a7cd-0693bc569592 req-bb4e3693-0523-4035-a953-6c5120129456 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038411 Aug 24 16:51:38.118496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 450/904] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:38.608328 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:38.611046 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:38.622645 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:38.623467 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:38.624958 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:38.625333 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:38.625774 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:38.627236 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:38.627931 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:38.628641 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:38.632960 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:38.633456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:38.633901 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:38.634653 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:38.635111 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:38.635539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:38.648455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] HTTP exception thrown: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Request method failure captured: Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a HTTP/1.1 Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVuSAm5KlbSCH_QNRV76U_n45ZpC6Kno_a1a5BQWoH64F0TyGS0lfulVbmcR4odEfv2HlZFqz_pH7JD40AlmwEVLOzb_z21pySDElxLqvtnhD2YCnAMAIF0nH8pFn3MKF0lBpm86j73vOXnS320llPE2j1VdUsfXeDWzzDbpkLK8PU Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:51:38.650215 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b71890b7a23944ee939c4bd13408063f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 4ce12f8401f3479ba14e5e1c3133a71d Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:38.651902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '09b9c747-048e-4478-b065-0bd606ea331a'} Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:38.653023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:38.654538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:38.655946 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Returning 404 to user: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:38.656028 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:38.656254 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-23260a33-7d4c-4345-a665-8c28191aaed3 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 404 len: 111 microversion: 2.1 time: 0.051218 Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 HTTP/1.1 Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:51:38.656366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:38.657603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '5fdefed9-549e-4154-9e78-a9d762019d38'} Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:38.658417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:38.659622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:38.662565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:38.662565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7595d97f-f214-4af3-9264-d52487bad586 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 404 len: 111 microversion: 2.1 time: 0.042249 Aug 24 16:51:38.662565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 451/905] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:38 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:51:38.662812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 455/906] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:38 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:38.666600 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3e61c4bd-7b91-4ede-9eb3-03a6b2c516f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '.version_select at 0x7f06a743d280>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:38.671876 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-32a00f1e-f45d-421d-996d-557a48442b13 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '.version_select at 0x7f06a6ee5e50>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:38.749417 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3e61c4bd-7b91-4ede-9eb3-03a6b2c516f1 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397120318" status: 202 len: 0 microversion: 2.1 time: 0.088648 Aug 24 16:51:38.750221 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 452/907] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 24 16:51:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397120318 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:51:38.806631 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-32a00f1e-f45d-421d-996d-557a48442b13 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769539149" status: 202 len: 0 microversion: 2.1 time: 0.138697 Aug 24 16:51:38.807214 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 456/908] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 24 16:51:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769539149 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:51:39.023341 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:39.024140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:39.034514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:39.042329 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:39.042786 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:39.043558 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:39.044024 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:39.044483 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:39.415858 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:39.429875 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:39.432134 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:39.433636 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1b4a3c18-0587-4ec3-a23c-9a6b85f8e772 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.414678 Aug 24 16:51:39.435416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 453/909] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:39 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:51:40.469144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:40.470618 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:40.482050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:40.482940 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:40.483679 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:40.484721 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:40.485595 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:40.486455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:40.970948 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:40.982500 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:40.984520 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:40.986397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-cb5124f8-5bbb-47c8-9860-7636836fc888 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.522538 Aug 24 16:51:40.987133 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 457/910] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:40 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:41.477414 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:41.478388 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:41.485951 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:41.486691 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:41.487688 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:41.488818 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:41.489715 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:41.491566 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:41.512606 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:41.514504 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 HTTP/1.1 Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:51:41.516551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:41.518096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '5fdefed9-549e-4154-9e78-a9d762019d38'} Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:41.518907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:41.520283 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:41.523849 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:41.525096 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cd251668-b663-48a7-bb50-87979ba751fd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 404 len: 111 microversion: 2.1 time: 0.054750 Aug 24 16:51:41.525895 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 454/911] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:51:41 2022] DELETE /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:41.536437 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:41.538541 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 5fdefed9-549e-4154-9e78-a9d762019d38] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:41.546633 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:41.547637 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:41.548423 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:41.549401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:41.550425 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:41.551254 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:41.571240 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 HTTP/1.1 Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:51:41.573506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:41.575088 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '5fdefed9-549e-4154-9e78-a9d762019d38'} Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:41.576036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. Aug 24 16:51:41.577398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:41.580430 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance 5fdefed9-549e-4154-9e78-a9d762019d38 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:41.582415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-298b9571-81d5-4d18-8a96-6bbfa3921d78 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38" status: 404 len: 111 microversion: 2.1 time: 0.051476 Aug 24 16:51:41.584306 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 458/912] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:41 2022] GET /compute/v2.1/servers/5fdefed9-549e-4154-9e78-a9d762019d38 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:42.012732 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:42.013559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:42.026233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:42.026882 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:42.027358 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:42.029146 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:42.029736 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:42.030578 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:42.194365 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:42.203484 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:42.205223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:42.206288 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e6b5d493-1ab1-4e86-88ab-e5a0e5dedbcc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.198213 Aug 24 16:51:42.206892 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 455/913] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:42 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:42.965939 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:42.966440 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:42.984707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:42.985638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:42.987788 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:42.988729 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:42.989553 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:42.993232 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:42.994450 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:42.994938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:42.995449 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:42.995617 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:42.996233 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:42.997273 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:42.997903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:42.998567 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:43.002705 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:43.017841 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:51:43.018977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] HTTP exception thrown: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Request method failure captured: Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a HTTP/1.1 Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVuSAm5KlbSCH_QNRV76U_n45ZpC6Kno_a1a5BQWoH64F0TyGS0lfulVbmcR4odEfv2HlZFqz_pH7JD40AlmwEVLOzb_z21pySDElxLqvtnhD2YCnAMAIF0nH8pFn3MKF0lBpm86j73vOXnS320llPE2j1VdUsfXeDWzzDbpkLK8PU Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:51:43.021032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b71890b7a23944ee939c4bd13408063f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 4ce12f8401f3479ba14e5e1c3133a71d Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:43.022897 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '09b9c747-048e-4478-b065-0bd606ea331a'} Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:43.023859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:43.025894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: DELETE /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 HTTP/1.1 Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:51:43.028528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:51:43.031124 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '75981127-7926-42dc-9ab3-1fe58eaf63e2'} Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:43.032647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:51:43.034725 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.044947 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Returning 404 to user: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:43.045266 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:43.045374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-41531bc3-3d52-4564-874a-7e99e34a76c8 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "DELETE /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 404 len: 111 microversion: 2.1 time: 0.043985 Aug 24 16:51:43.045563 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6e55f866-df82-4acc-907a-97be202c66c5 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 404 len: 111 microversion: 2.1 time: 0.064181 Aug 24 16:51:43.045563 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 459/914] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:51:42 2022] DELETE /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:43.046084 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 456/915] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:51:42 2022] DELETE /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:43.046216 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:43.046216 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: 09b9c747-048e-4478-b065-0bd606ea331a] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:43.046379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:43.046888 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 75981127-7926-42dc-9ab3-1fe58eaf63e2] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:43.062073 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:43.062574 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:43.064112 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:43.066013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:43.066524 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:43.083372 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:43.083372 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:43.083967 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:43.084063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:43.084153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:43.084153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:43.084153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:43.091822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 HTTP/1.1 Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:51:43.093694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:51:43.095359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '75981127-7926-42dc-9ab3-1fe58eaf63e2'} Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:43.096307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. Aug 24 16:51:43.098526 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.101803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance 75981127-7926-42dc-9ab3-1fe58eaf63e2 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:43.101803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2253942a-3e38-4f18-a583-f70d11998631 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2" status: 404 len: 111 microversion: 2.1 time: 0.067048 Aug 24 16:51:43.101803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 457/916] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:43 2022] GET /compute/v2.1/servers/75981127-7926-42dc-9ab3-1fe58eaf63e2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:43.118113 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:43.119026 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:43.131873 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:43.133065 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:43.134280 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:43.135440 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] HTTP exception thrown: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:43.136443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:43.137395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Request method failure captured: Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a HTTP/1.1 Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVuSAm5KlbSCH_QNRV76U_n45ZpC6Kno_a1a5BQWoH64F0TyGS0lfulVbmcR4odEfv2HlZFqz_pH7JD40AlmwEVLOzb_z21pySDElxLqvtnhD2YCnAMAIF0nH8pFn3MKF0lBpm86j73vOXnS320llPE2j1VdUsfXeDWzzDbpkLK8PU Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:51:43.137730 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b71890b7a23944ee939c4bd13408063f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 4ce12f8401f3479ba14e5e1c3133a71d Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:43.139402 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '09b9c747-048e-4478-b065-0bd606ea331a'} Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:43.140568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. Aug 24 16:51:43.142793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.144827 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Returning 404 to user: Instance 09b9c747-048e-4478-b065-0bd606ea331a could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:43.144827 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-98e3a94d-0b39-4838-b61b-b3ddf4fe2394 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a" status: 404 len: 111 microversion: 2.1 time: 0.110797 Aug 24 16:51:43.144827 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 460/917] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:43 2022] GET /compute/v2.1/servers/09b9c747-048e-4478-b065-0bd606ea331a => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:43.146275 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:43.170500 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 HTTP/1.1 Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:51:43.172123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:51:43.181939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': 'e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4'} Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:43.182782 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:51:43.184216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.185631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:43.185631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-94d3414f-9c9d-4924-9c98-a27d6a825e01 tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 404 len: 111 microversion: 2.1 time: 0.070329 Aug 24 16:51:43.185631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 458/918] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:51:43 2022] DELETE /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:43.197453 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:43.201339 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:43.223662 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:43.225305 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:43.240379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:43.241864 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:43.242767 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:43.243478 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:43.247692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:43.248912 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:43.266232 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:43.272568 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:43.272568 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:43.272568 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:43.272568 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:43.273092 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:43.276414 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 HTTP/1.1 Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:51:43.277966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:51:43.279587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': 'e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4'} Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:43.280459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. Aug 24 16:51:43.281909 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:43.284332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:43.285986 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7e370251-bd53-4030-9cd0-03db229bf6ec tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4" status: 404 len: 111 microversion: 2.1 time: 0.099884 Aug 24 16:51:43.287593 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 461/919] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:43 2022] GET /compute/v2.1/servers/e85dfd9e-5f29-4ed1-9f28-849e9c0db6d4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:43.527475 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:43.547699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:43.550007 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:43.552498 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a53eb030-65f8-4fd4-b142-35c5d2bfdace tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.323927 Aug 24 16:51:43.568845 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 459/920] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:43 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:44.598321 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:44.599509 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:44.613036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:44.614489 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:44.615786 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:44.616702 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:44.617336 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:44.617977 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:44.850550 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:44.867141 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:44.871158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:44.874175 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-86c02007-de7c-4e66-bbb9-82e6ec54eb7c tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.294286 Aug 24 16:51:44.907423 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 462/921] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:44 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:44.941360 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:44.942069 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:44.951728 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:44.964803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:44.964803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:44.964803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:44.964803 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:44.965544 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:44.973542 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:44.975864 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:44.991083 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:44.992673 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:44.994069 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:44.996646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:44.997312 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:45.016524 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:45.030297 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac HTTP/1.1 Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:51:45.031837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:51:45.033352 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '2c63f0ac-d4f8-499f-8901-53d4dbbc15ac'} Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:45.034120 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:51:45.035308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.039004 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] HTTP exception thrown: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:51:45.040334 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:45.045249 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0916a09b-9985-423a-9eb9-300518eed2bc tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 404 len: 111 microversion: 2.1 time: 0.111513 Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Request method failure captured: Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: DELETE /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 HTTP/1.1 Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVuSAm5KlbSCH_QNRV76U_n45ZpC6Kno_a1a5BQWoH64F0TyGS0lfulVbmcR4odEfv2HlZFqz_pH7JD40AlmwEVLOzb_z21pySDElxLqvtnhD2YCnAMAIF0nH8pFn3MKF0lBpm86j73vOXnS320llPE2j1VdUsfXeDWzzDbpkLK8PU Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:51:45.046568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b71890b7a23944ee939c4bd13408063f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 4ce12f8401f3479ba14e5e1c3133a71d Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:51:45.048292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': 'fcfcc291-21b3-42f0-9398-eeebfa0e9af8'} Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:45.051103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:51:45.056234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.057802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Returning 404 to user: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:45.057802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b099106d-3f82-4892-8123-3bd3a31e0c52 tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 404 len: 111 microversion: 2.1 time: 0.083627 Aug 24 16:51:45.057802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 463/922] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:51:44 2022] DELETE /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:45.063348 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 460/923] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:51:44 2022] DELETE /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:45.063554 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:45.063554 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] [instance: fcfcc291-21b3-42f0-9398-eeebfa0e9af8] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:45.070294 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:45.080222 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] [instance: 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:45.081434 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:45.081961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:45.082404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:45.085954 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:45.086761 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:45.087265 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:45.094179 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:45.094649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:45.096386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:45.096386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:45.096386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:45.096820 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:45.118251 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] HTTP exception thrown: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Request method failure captured: Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac HTTP/1.1 Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlVoljVBtjZfBNW51gyXurW1cv-K7kLdyT6FJ418jYp_8NAXcRlHkC_MoIv4hkV3MpAsXJsJ--SfaZfFAKrWrfrovQp9jb2RVSQZZZE_enxh_J0FSYGZkRYFdZGvvra_ksJqWoS2w_04lqrhSSHVNL0lFLQI00otf-Y0cBR2_33W9_c Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:51:45.119835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8af535d51fd345f8a9584cc6aaa38bda", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8af535d51fd345f8a9584cc6aaa38bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 8af535d51fd345f8a9584cc6aaa38bda Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-321664241 Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 1d9f7755863d45bfb04a1498bd62e367 Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-321664241-project Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:51:45.121386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '2c63f0ac-d4f8-499f-8901-53d4dbbc15ac'} Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:45.125453 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. Aug 24 16:51:45.126977 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.128649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] Returning 404 to user: Instance 2c63f0ac-d4f8-499f-8901-53d4dbbc15ac could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:45.128649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bba70421-667e-4828-a33f-64e8c56cf0bd tempest-AttachVolumeNegativeTest-321664241 tempest-AttachVolumeNegativeTest-321664241-project] 10.222.0.17 "GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac" status: 404 len: 111 microversion: 2.1 time: 0.056166 Aug 24 16:51:45.128649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 461/924] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:45 2022] GET /compute/v2.1/servers/2c63f0ac-d4f8-499f-8901-53d4dbbc15ac => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:45.146005 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] HTTP exception thrown: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Request method failure captured: Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 HTTP/1.1 Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlVuSAm5KlbSCH_QNRV76U_n45ZpC6Kno_a1a5BQWoH64F0TyGS0lfulVbmcR4odEfv2HlZFqz_pH7JD40AlmwEVLOzb_z21pySDElxLqvtnhD2YCnAMAIF0nH8pFn3MKF0lBpm86j73vOXnS320llPE2j1VdUsfXeDWzzDbpkLK8PU Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:51:45.148906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b71890b7a23944ee939c4bd13408063f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b71890b7a23944ee939c4bd13408063f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: b71890b7a23944ee939c4bd13408063f Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1813607603 Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 4ce12f8401f3479ba14e5e1c3133a71d Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeTestJSON-1813607603-project Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:51:45.151558 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': 'fcfcc291-21b3-42f0-9398-eeebfa0e9af8'} Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:45.153168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. Aug 24 16:51:45.155952 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:45.158122 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] Returning 404 to user: Instance fcfcc291-21b3-42f0-9398-eeebfa0e9af8 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:45.158122 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7145bcf1-87e7-4366-b3aa-279b1d01814c tempest-AttachVolumeTestJSON-1813607603 tempest-AttachVolumeTestJSON-1813607603-project] 10.222.0.17 "GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8" status: 404 len: 111 microversion: 2.1 time: 0.096346 Aug 24 16:51:45.165492 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 464/925] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:45 2022] GET /compute/v2.1/servers/fcfcc291-21b3-42f0-9398-eeebfa0e9af8 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:51:45.920606 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:45.922678 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:45.932243 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:45.933077 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:45.933735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:45.938732 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:45.945475 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:45.948919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:46.412080 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:46.456963 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:46.464726 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:46.468437 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e9b953d5-252d-4346-86b8-15ef35aeab7a tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.557647 Aug 24 16:51:46.469525 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 462/926] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:45 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:46.515311 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a34bf4a8-bba2-43d5-a103-fa31435ac888 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:46.518414 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a34bf4a8-bba2-43d5-a103-fa31435ac888 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:46.520682 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-00c832ab-32fe-4ff4-99c7-1321ae45bd00 req-57c30722-8fbe-4dc7-ac6c-705b8826c506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b4ea3cd-ed8d-4169-8be6-716b693de76d", "tag": "a3e2b5de-778c-4f0f-bb74-761971b6f904"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:46.543068 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-00c832ab-32fe-4ff4-99c7-1321ae45bd00 req-57c30722-8fbe-4dc7-ac6c-705b8826c506 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:46.547286 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a34bf4a8-bba2-43d5-a103-fa31435ac888 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:46.548039 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a34bf4a8-bba2-43d5-a103-fa31435ac888 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:46.549557 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-00c832ab-32fe-4ff4-99c7-1321ae45bd00 req-57c30722-8fbe-4dc7-ac6c-705b8826c506 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:46.550817 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-00c832ab-32fe-4ff4-99c7-1321ae45bd00 req-57c30722-8fbe-4dc7-ac6c-705b8826c506 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:46.551025 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a34bf4a8-bba2-43d5-a103-fa31435ac888 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:46.551615 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a34bf4a8-bba2-43d5-a103-fa31435ac888 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:46.552084 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a34bf4a8-bba2-43d5-a103-fa31435ac888 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:46.556592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a34bf4a8-bba2-43d5-a103-fa31435ac888 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:46.578992 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-00c832ab-32fe-4ff4-99c7-1321ae45bd00 req-57c30722-8fbe-4dc7-ac6c-705b8826c506 service nova] Creating event network-changed:a3e2b5de-778c-4f0f-bb74-761971b6f904 for instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d on hv-cinder-73116 Aug 24 16:51:46.589682 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-00c832ab-32fe-4ff4-99c7-1321ae45bd00 req-57c30722-8fbe-4dc7-ac6c-705b8826c506 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072189 Aug 24 16:51:46.591648 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 463/927] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:46.653860 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a34bf4a8-bba2-43d5-a103-fa31435ac888 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Going to try to terminate instance {{(pid=127626) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:51:47.217227 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a34bf4a8-bba2-43d5-a103-fa31435ac888 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 204 len: 0 microversion: 2.1 time: 0.707808 Aug 24 16:51:47.222159 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 465/928] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:51:46 2022] DELETE /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 0 bytes in 710 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:51:47.232645 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7ab3a32a-48c8-4ee2-9db4-1318039aae51 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:47.233364 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7ab3a32a-48c8-4ee2-9db4-1318039aae51 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:47.253053 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ab3a32a-48c8-4ee2-9db4-1318039aae51 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:47.258593 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ab3a32a-48c8-4ee2-9db4-1318039aae51 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:47.258593 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ab3a32a-48c8-4ee2-9db4-1318039aae51 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:47.258593 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ab3a32a-48c8-4ee2-9db4-1318039aae51 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:47.258593 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ab3a32a-48c8-4ee2-9db4-1318039aae51 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:47.259435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ab3a32a-48c8-4ee2-9db4-1318039aae51 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:47.497614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:47.501279 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:47.505017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:47.506330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:47.507096 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:47.508001 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:47.508669 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:47.509243 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:48.216813 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7ab3a32a-48c8-4ee2-9db4-1318039aae51 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:48.235270 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7ab3a32a-48c8-4ee2-9db4-1318039aae51 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 1.010428 Aug 24 16:51:48.244907 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 464/929] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:47 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:48.358739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:48.373379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:48.384769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:48.387146 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-4c704cc7-4c73-41f7-abe0-188d5fd119bc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.894105 Aug 24 16:51:48.388436 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 466/930] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:47 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:51:49.261427 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c994a7c3-1328-4a69-b093-a0d08110ed7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:49.264136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c994a7c3-1328-4a69-b093-a0d08110ed7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:49.282262 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c994a7c3-1328-4a69-b093-a0d08110ed7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:49.283326 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c994a7c3-1328-4a69-b093-a0d08110ed7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:49.284477 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c994a7c3-1328-4a69-b093-a0d08110ed7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:49.286622 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c994a7c3-1328-4a69-b093-a0d08110ed7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:49.288378 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c994a7c3-1328-4a69-b093-a0d08110ed7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:49.290296 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c994a7c3-1328-4a69-b093-a0d08110ed7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:49.425754 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:49.427136 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:49.449041 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:49.449999 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:49.450624 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:49.451712 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:49.452675 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:49.453333 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:49.996217 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:50.006773 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:50.017097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:50.017097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8dd64751-7789-4ab7-be24-65cd8f84e0a5 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.589164 Aug 24 16:51:50.017097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 467/931] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:49 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:50.087539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c994a7c3-1328-4a69-b093-a0d08110ed7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:50.096678 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c994a7c3-1328-4a69-b093-a0d08110ed7f tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.841124 Aug 24 16:51:50.099308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 465/932] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:49 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:51.043921 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:51.044726 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:51.056129 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:51.056652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:51.057087 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:51.057790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:51.058279 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:51.058764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:51.118475 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-27fc6ff1-ec4e-4f6d-96d1-4e82f7cc6349 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:51.119914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-27fc6ff1-ec4e-4f6d-96d1-4e82f7cc6349 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:51.122474 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:51.129290 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27fc6ff1-ec4e-4f6d-96d1-4e82f7cc6349 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:51.129808 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27fc6ff1-ec4e-4f6d-96d1-4e82f7cc6349 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:51.130445 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27fc6ff1-ec4e-4f6d-96d1-4e82f7cc6349 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:51.131911 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27fc6ff1-ec4e-4f6d-96d1-4e82f7cc6349 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:51.132391 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27fc6ff1-ec4e-4f6d-96d1-4e82f7cc6349 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:51.136548 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-27fc6ff1-ec4e-4f6d-96d1-4e82f7cc6349 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:51.690378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:51.701534 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:51.703087 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:51.704478 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3b1c4bb3-5f81-4996-b478-10b320ac8b4f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.664765 Aug 24 16:51:51.705160 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 468/933] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:51 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:51:51.806382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-27fc6ff1-ec4e-4f6d-96d1-4e82f7cc6349 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:51.821779 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-27fc6ff1-ec4e-4f6d-96d1-4e82f7cc6349 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1568 microversion: 2.1 time: 0.707091 Aug 24 16:51:51.823016 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 466/934] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:51 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1568 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:51:52.290754 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-d1a85b91-1577-4866-bbaf-b7ba868b5f11 req-05ea4d6a-5370-477b-b532-85977b4e1935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4ea3cd-ed8d-4169-8be6-716b693de76d", "name": "network-vif-deleted", "tag": "a3e2b5de-778c-4f0f-bb74-761971b6f904"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:52.305156 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:52.315744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d1a85b91-1577-4866-bbaf-b7ba868b5f11 req-05ea4d6a-5370-477b-b532-85977b4e1935 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:52.316742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d1a85b91-1577-4866-bbaf-b7ba868b5f11 req-05ea4d6a-5370-477b-b532-85977b4e1935 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:52.317406 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-d1a85b91-1577-4866-bbaf-b7ba868b5f11 req-05ea4d6a-5370-477b-b532-85977b4e1935 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:52.339908 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-d1a85b91-1577-4866-bbaf-b7ba868b5f11 req-05ea4d6a-5370-477b-b532-85977b4e1935 service nova] Creating event network-vif-deleted:a3e2b5de-778c-4f0f-bb74-761971b6f904 for instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d on hv-cinder-73116 Aug 24 16:51:52.346870 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-d1a85b91-1577-4866-bbaf-b7ba868b5f11 req-05ea4d6a-5370-477b-b532-85977b4e1935 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077990 Aug 24 16:51:52.348120 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 469/935] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:52.740804 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:52.743280 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:52.763000 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:52.764397 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:52.766011 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:52.768576 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:52.771853 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:52.777853 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:52.864014 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2c144e85-a062-4b94-97b9-2e98c4507a11 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:52.868110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2c144e85-a062-4b94-97b9-2e98c4507a11 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:52.904150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c144e85-a062-4b94-97b9-2e98c4507a11 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:52.906600 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c144e85-a062-4b94-97b9-2e98c4507a11 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:52.907390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c144e85-a062-4b94-97b9-2e98c4507a11 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:52.908297 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c144e85-a062-4b94-97b9-2e98c4507a11 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:52.910390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c144e85-a062-4b94-97b9-2e98c4507a11 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:52.917086 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c144e85-a062-4b94-97b9-2e98c4507a11 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:53.079440 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2c144e85-a062-4b94-97b9-2e98c4507a11 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:53.095557 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2c144e85-a062-4b94-97b9-2e98c4507a11 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1220 microversion: 2.1 time: 0.255134 Aug 24 16:51:53.096179 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 470/936] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:52 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1220 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:53.234422 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:53.245441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:53.247752 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:53.249600 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-99414a5b-0122-4d85-84c4-3e60d3c9f6fb tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.513473 Aug 24 16:51:53.250302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 467/937] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:52 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:54.126346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:54.126966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:54.135824 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:54.135824 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:54.136163 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:54.136707 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:54.137171 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:54.137598 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:54.189134 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:54.189709 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:54.190196 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:54.190866 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lazy-loading 'fault' on Instance uuid 4b4ea3cd-ed8d-4169-8be6-716b693de76d {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:51:54.288027 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:54.289635 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:54.298776 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10bf98bc784be7bf2f8fde1ddbef44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a8a1a0e0334559ab3fc9a63685fa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:54.310428 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:54.312258 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:54.312697 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1e9283e5-d585-4111-b6ee-e99cad834842 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 200 len: 1225 microversion: 2.1 time: 0.191250 Aug 24 16:51:54.313696 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 471/938] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:54 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 1225 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:54.313903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:54.316398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:54.318839 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:54.319796 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:54.647627 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:54.672142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:54.673751 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:54.674995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-879b56a5-8c5d-400e-bc96-2a789033ada4 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.403866 Aug 24 16:51:54.678900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 468/939] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:54 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:55.336404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:55.337764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] [instance: 4b4ea3cd-ed8d-4169-8be6-716b693de76d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:55.345728 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:55.346257 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:55.346691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:55.348706 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:55.348706 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:55.349018 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:55.366731 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] HTTP exception thrown: Instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d could not be found. Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Request method failure captured: Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d HTTP/1.1 Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlXWUFfNAe7-s6q6Thrx8U7Fwn5OZPbs9wbHg_eh81tWnF94KWBNZ24-VGQQlpH8_0XhLF-O_VGdYtJ0gic4ecJzequD1bXbUkWtVTBB-HnsYPXkUOdh5VVK9-hb2SEzvI7vIjS15POxddTsq9a_3JdLX2fB4SLl43KbYGQxwnbAnPc Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 05a8a1a0e0334559ab3fc9a63685fa69 Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-TestShelveInstance-1595561412 Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:51:55.371261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/05a8a1a0e0334559ab3fc9a63685fa69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/05a8a1a0e0334559ab3fc9a63685fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_05a8a1a0e0334559ab3fc9a63685fa69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/05a8a1a0e0334559ab3fc9a63685fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-TestShelveInstance-1595561412 Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 05a8a1a0e0334559ab3fc9a63685fa69 Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-TestShelveInstance-1595561412 Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-TestShelveInstance-1595561412-project Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 5f10bf98bc784be7bf2f8fde1ddbef44 Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-TestShelveInstance-1595561412-project Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d could not be found. Aug 24 16:51:55.373401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '4b4ea3cd-ed8d-4169-8be6-716b693de76d'} Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d could not be found. Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:51:55.374525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d could not be found. Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d could not be found. Aug 24 16:51:55.376914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:51:55.378906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Returning 404 to user: Instance 4b4ea3cd-ed8d-4169-8be6-716b693de76d could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:51:55.378906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-797c0104-782b-4b4c-a07a-f9df820637ed tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d" status: 404 len: 111 microversion: 2.1 time: 0.045870 Aug 24 16:51:55.380041 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 472/940] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:55 2022] GET /compute/v2.1/servers/4b4ea3cd-ed8d-4169-8be6-716b693de76d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:51:55.722699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:55.723738 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:55.733752 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:55.734279 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:55.734724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:55.735441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:55.735891 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:55.736316 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:55.909085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:55.922116 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:55.923734 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:55.925196 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fa0a654f-fcf4-4a15-b9b3-fd3b62cf4d27 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.208857 Aug 24 16:51:55.925618 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 469/941] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:55 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:56.117390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7f89eada-b197-4423-9832-326763a18899 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] Calling method '.version_select at 0x7f06acb98b80>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:56.248158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7f89eada-b197-4423-9832-326763a18899 tempest-TestShelveInstance-1595561412 tempest-TestShelveInstance-1595561412-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1562779701" status: 202 len: 0 microversion: 2.1 time: 0.136644 Aug 24 16:51:56.250646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 473/942] 10.222.0.17 () {58 vars in 1254 bytes} [Wed Aug 24 16:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1562779701 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:51:56.953778 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:56.954774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:56.965384 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:56.966123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:56.966809 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:56.967747 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:56.968605 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:56.969220 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:57.533512 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:57.543004 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:57.544629 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:57.546032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3c625bf9-666a-40be-902e-4fe27a7e2a35 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.599436 Aug 24 16:51:57.546705 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 470/943] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:56 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:58.573775 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:58.574397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:58.582325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:58.582844 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:58.583602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:58.584486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:58.585065 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:58.585701 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:58.840078 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-278c5f28-d624-4daa-b454-f6f83f62618b req-3946b716-586e-4b9a-b10a-4c239b06ac16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75145055-cbf0-4840-b4fc-a2907f7b8f1c", "name": "network-vif-plugged", "status": "completed", "tag": "2f2e239d-8035-4f37-96dd-4e4f3002af3d"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:58.851130 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:58.860421 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-278c5f28-d624-4daa-b454-f6f83f62618b req-3946b716-586e-4b9a-b10a-4c239b06ac16 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:58.860911 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-278c5f28-d624-4daa-b454-f6f83f62618b req-3946b716-586e-4b9a-b10a-4c239b06ac16 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:58.861286 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:58.861441 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-278c5f28-d624-4daa-b454-f6f83f62618b req-3946b716-586e-4b9a-b10a-4c239b06ac16 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:58.862829 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:58.864133 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a99c41fe-f91a-4e80-9e61-6abbc9615614 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.295049 Aug 24 16:51:58.865639 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 474/944] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:58 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:51:58.889607 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-278c5f28-d624-4daa-b454-f6f83f62618b req-3946b716-586e-4b9a-b10a-4c239b06ac16 service nova] Creating event network-vif-plugged:2f2e239d-8035-4f37-96dd-4e4f3002af3d for instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c on hv-cinder-73116 Aug 24 16:51:58.898750 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-278c5f28-d624-4daa-b454-f6f83f62618b req-3946b716-586e-4b9a-b10a-4c239b06ac16 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063438 Aug 24 16:51:58.900652 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 471/945] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:59.903508 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:59.903914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:59.916476 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:59.916999 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:59.917473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:59.918212 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:59.918753 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:59.919436 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:00.173884 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:00.184808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:00.186686 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:00.188221 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1a3aedae-ef3f-40e5-a1d0-e845cc8ffd10 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.297575 Aug 24 16:52:00.201025 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 475/946] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:51:59 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:01.227509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:01.233471 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:01.260454 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:01.269440 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:01.270123 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:01.271298 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:01.274367 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:01.275203 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:01.546649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:01.558442 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:01.560409 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:01.561833 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-06dafc25-7a69-450b-a1c1-1419e9f897ee tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.352413 Aug 24 16:52:01.581583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 472/947] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:01 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:02.604910 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:02.605789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:02.618997 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:02.619659 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:02.620246 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:02.624162 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:02.624875 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:02.625694 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:02.786233 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:02.798545 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:02.800075 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:02.801355 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-717a61d3-1196-4ee9-9a9a-097a41cde31e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1728 microversion: 2.20 time: 0.203393 Aug 24 16:52:02.801935 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 476/948] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:02 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:52:03.828669 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:03.829700 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:03.836851 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:03.840617 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:03.840617 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:03.840617 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:03.840617 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:03.841201 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:04.043113 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:04.054558 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:04.064242 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:04.064242 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1ea3e883-2add-4fc7-96d9-0e5f0a556c5e tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1715 microversion: 2.20 time: 0.234062 Aug 24 16:52:04.064242 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 473/949] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:03 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1715 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:34.358036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:34.360618 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:34.736995 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1597bb1e-c3f6-4744-a1e8-ae77b588847d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Action: 'create', calling method: .version_select at 0x7f06a6e48dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1100356887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj3hOFKpoINIwLIcxEXH31d6v1NnLz/+w5NrjeapAZ4DF0olg6iZovEVLCJkthFLlZWHJL7e/gsbeCca+7GCEtLq0TF6Quv5U30thjvwOQoyf//erY8c48ugCWjOHMVcw=="}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:34.797197 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-1597bb1e-c3f6-4744-a1e8-ae77b588847d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Getting quotas for project f18db8d724d4436cb1721859066ac74d. Resources: {'key_pairs'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:52:34.812379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-1597bb1e-c3f6-4744-a1e8-ae77b588847d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Getting quotas for user aaa4ddbee1034946a1f4dfe751a2b5cd and project f18db8d724d4436cb1721859066ac74d. Resources: {'key_pairs'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:52:35.050111 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1597bb1e-c3f6-4744-a1e8-ae77b588847d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.701051 Aug 24 16:52:35.051388 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 477/950] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 16:52:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:38.977921 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ba7fbbf8-99f6-4b95-8287-76ba1294aac6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:38.981473 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ba7fbbf8-99f6-4b95-8287-76ba1294aac6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:38.984083 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=15 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:38.987957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=86 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:39.000285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ba7fbbf8-99f6-4b95-8287-76ba1294aac6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.001689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ba7fbbf8-99f6-4b95-8287-76ba1294aac6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.002421 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ba7fbbf8-99f6-4b95-8287-76ba1294aac6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:39.003374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ba7fbbf8-99f6-4b95-8287-76ba1294aac6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.004151 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ba7fbbf8-99f6-4b95-8287-76ba1294aac6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.004698 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ba7fbbf8-99f6-4b95-8287-76ba1294aac6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:39.054707 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ba7fbbf8-99f6-4b95-8287-76ba1294aac6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.081789 Aug 24 16:52:39.055309 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 474/951] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 24 16:52:38 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:39.140966 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1af289ad-e927-4507-9439-579a48d96ef9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:39.142030 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1af289ad-e927-4507-9439-579a48d96ef9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:39.158452 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1af289ad-e927-4507-9439-579a48d96ef9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.176399 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1af289ad-e927-4507-9439-579a48d96ef9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.176399 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1af289ad-e927-4507-9439-579a48d96ef9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:39.176399 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1af289ad-e927-4507-9439-579a48d96ef9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.176399 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1af289ad-e927-4507-9439-579a48d96ef9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.176800 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1af289ad-e927-4507-9439-579a48d96ef9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:39.207505 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1af289ad-e927-4507-9439-579a48d96ef9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Going to try to terminate instance {{(pid=127626) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:52:39.863181 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1af289ad-e927-4507-9439-579a48d96ef9 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 204 len: 0 microversion: 2.20 time: 0.726970 Aug 24 16:52:39.866699 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 478/952] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 24 16:52:39 2022] DELETE /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:52:39.872825 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:39.873519 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:39.880012 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.880625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.881193 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:39.881994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.882837 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.883340 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:40.047068 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:40.057638 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:40.059406 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:40.060788 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cd969f3f-bdec-4a3e-97e8-3b47ae100292 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.192167 Aug 24 16:52:40.061542 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 475/953] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:39 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:41.085671 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:41.086443 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:41.095795 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:41.096592 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:41.097185 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:41.098036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:41.098640 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:41.099348 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:41.278068 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:41.291118 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:41.295372 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:41.297509 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e658a50d-dfc6-4131-b490-79de3e7cb199 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1721 microversion: 2.20 time: 0.216074 Aug 24 16:52:41.300892 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 479/954] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:41 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:42.335765 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:42.337350 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:42.344815 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:42.345493 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:42.345939 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:42.346644 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:42.347290 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:42.347723 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:42.425172 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:42.441371 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:42.443174 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:42.445583 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1d404b9a-02ba-476e-a06d-43226ce5e9c8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1654 microversion: 2.20 time: 0.125368 Aug 24 16:52:42.449695 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 476/955] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:42 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1654 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:52:42.685658 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-51a19d82-722e-40e6-9412-74a8f95b0f8a req-f4e0fd8a-9327-4752-bda8-14975e948dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75145055-cbf0-4840-b4fc-a2907f7b8f1c", "name": "network-vif-deleted", "tag": "2f2e239d-8035-4f37-96dd-4e4f3002af3d"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:42.699061 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-51a19d82-722e-40e6-9412-74a8f95b0f8a req-f4e0fd8a-9327-4752-bda8-14975e948dac service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:42.699563 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-51a19d82-722e-40e6-9412-74a8f95b0f8a req-f4e0fd8a-9327-4752-bda8-14975e948dac service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:42.700092 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-51a19d82-722e-40e6-9412-74a8f95b0f8a req-f4e0fd8a-9327-4752-bda8-14975e948dac service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:42.715937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-51a19d82-722e-40e6-9412-74a8f95b0f8a req-f4e0fd8a-9327-4752-bda8-14975e948dac service nova] Creating event network-vif-deleted:2f2e239d-8035-4f37-96dd-4e4f3002af3d for instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c on hv-cinder-73116 Aug 24 16:52:42.727339 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-51a19d82-722e-40e6-9412-74a8f95b0f8a req-f4e0fd8a-9327-4752-bda8-14975e948dac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045910 Aug 24 16:52:42.735741 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 480/956] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:43.477124 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:43.478433 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:43.492666 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:43.493550 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:43.494563 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:43.496379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:43.497222 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:43.497967 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:43.565111 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:43.575973 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:43.575973 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:43.575973 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lazy-loading 'fault' on Instance uuid 75145055-cbf0-4840-b4fc-a2907f7b8f1c {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:52:43.621733 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:43.631661 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:43.633456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:43.634759 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cc7edd0a-0b30-4ccb-b504-70e4ee184f8b tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1370 microversion: 2.20 time: 0.167910 Aug 24 16:52:43.635392 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 477/957] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:43 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:44.679642 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:44.680581 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:44.687706 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:44.688390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:44.688965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:44.689793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:44.690341 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:44.690872 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:44.724414 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:44.725507 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:44.726039 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:44.726486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lazy-loading 'fault' on Instance uuid 75145055-cbf0-4840-b4fc-a2907f7b8f1c {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:52:44.771011 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:44.779774 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:44.781290 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:44.782461 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-78cfcbaf-a9e2-47e6-a675-f81d6c6fa671 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1370 microversion: 2.20 time: 0.109513 Aug 24 16:52:44.783034 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 481/958] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:44 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1370 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:45.806523 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:45.808009 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:45.816240 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.817166 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.817811 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.818303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.818615 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.819144 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.854330 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.854809 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.855256 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.855703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lazy-loading 'fault' on Instance uuid 75145055-cbf0-4840-b4fc-a2907f7b8f1c {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:52:45.911656 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:45.923632 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:45.925214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:45.926380 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d2f4ed5f-71be-4894-842d-76381d1eb28f tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1370 microversion: 2.20 time: 0.124170 Aug 24 16:52:45.926980 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 478/959] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:45 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1370 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:52:46.090282 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:52:46.090468 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Wed Aug 24 16:52:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:52:46.953411 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:46.954271 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:46.956563 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=4 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:46.969968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:46.969968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:46.969968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:46.969968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:46.970473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:46.971907 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:47.010416 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:47.010893 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:47.011318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:47.011763 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lazy-loading 'fault' on Instance uuid 75145055-cbf0-4840-b4fc-a2907f7b8f1c {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:52:47.082690 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:47.097175 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:47.098669 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc27435df46542a3ac37e743b6399387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f30f320fa04cdfa0e1d4ea9050119c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:47.100352 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3c48e631-76e8-4cbe-b1d7-d0cb768025bf tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 200 len: 1370 microversion: 2.20 time: 0.150893 Aug 24 16:52:47.101242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 482/960] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:46 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:52:48.125189 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:48.125834 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:48.134490 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:48.134990 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:48.135466 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:48.136449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:48.136912 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:48.137443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:48.157225 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] HTTP exception thrown: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Request method failure captured: Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c HTTP/1.1 Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlW3A2Z4Gr_7m650eNJevLJRwbdj-fG2G0izi-msGweQQMpanIoQFLiISwhTFLNi7XwTHBav_tdxfj7Ld1MD8TgKaUpzaps9Mwe7dKyHDEW8OUcaTcnw3G4YawdFoTHGNr0Q8Ceu8U0lE7BrBT3YWOmUd6UcPMMKOxjWrxN4GX3EENE Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:52:48.160664 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_52f30f320fa04cdfa0e1d4ea9050119c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: fc27435df46542a3ac37e743b6399387 Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:48.162724 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '75145055-cbf0-4840-b4fc-a2907f7b8f1c'} Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:52:48.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:48.166374 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:52:48.168060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Returning 404 to user: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:52:48.168060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-eae40c4d-f22e-4817-88c0-e4b67173bc76 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 404 len: 111 microversion: 2.20 time: 0.042103 Aug 24 16:52:48.168060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 479/961] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:48 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:52:48.173851 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9df0509e-32cf-435c-88b0-18c4ad6520b6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '.version_select at 0x7f06ac0fa8b0>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:48.294900 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9df0509e-32cf-435c-88b0-18c4ad6520b6 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-316277663" status: 204 len: 0 microversion: 2.20 time: 0.125215 Aug 24 16:52:48.295548 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 483/962] 10.222.0.17 () {60 vars in 1259 bytes} [Wed Aug 24 16:52:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-316277663 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:52:56.062999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1665926247", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "networks": [{"uuid": "60dfa6dd-f8ec-4f3a-84ef-367b2814b6c8"}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:56.150300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] validate_networks() for [('60dfa6dd-f8ec-4f3a-84ef-367b2814b6c8', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:52:56.212886 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:56.218709 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:56.221779 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:56.222279 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:56.222717 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:56.223471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:56.223954 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:56.224523 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:56.249559 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] HTTP exception thrown: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Request method failure captured: Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: DELETE /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c HTTP/1.1 Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlW3A2Z4Gr_7m650eNJevLJRwbdj-fG2G0izi-msGweQQMpanIoQFLiISwhTFLNi7XwTHBav_tdxfj7Ld1MD8TgKaUpzaps9Mwe7dKyHDEW8OUcaTcnw3G4YawdFoTHGNr0Q8Ceu8U0lE7BrBT3YWOmUd6UcPMMKOxjWrxN4GX3EENE Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:52:56.252119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_52f30f320fa04cdfa0e1d4ea9050119c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: fc27435df46542a3ac37e743b6399387 Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:56.253969 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '75145055-cbf0-4840-b4fc-a2907f7b8f1c'} Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:52:56.254814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:56.258167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:56.261238 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Returning 404 to user: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:52:56.261238 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e1c90054-8f4f-456f-8cc7-886cbe89d496 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 404 len: 111 microversion: 2.20 time: 0.048752 Aug 24 16:52:56.261238 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 484/963] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 24 16:52:56 2022] DELETE /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:52:56.267933 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:56.268437 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 75145055-cbf0-4840-b4fc-a2907f7b8f1c] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:56.276810 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:56.278232 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:56.278694 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:56.279847 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:56.280636 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:56.280858 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:56.296081 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] HTTP exception thrown: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Request method failure captured: Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c HTTP/1.1 Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlW3A2Z4Gr_7m650eNJevLJRwbdj-fG2G0izi-msGweQQMpanIoQFLiISwhTFLNi7XwTHBav_tdxfj7Ld1MD8TgKaUpzaps9Mwe7dKyHDEW8OUcaTcnw3G4YawdFoTHGNr0Q8Ceu8U0lE7BrBT3YWOmUd6UcPMMKOxjWrxN4GX3EENE Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:52:56.297346 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_52f30f320fa04cdfa0e1d4ea9050119c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: fc27435df46542a3ac37e743b6399387 Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:56.300332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '75145055-cbf0-4840-b4fc-a2907f7b8f1c'} Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:52:56.301974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. Aug 24 16:52:56.305622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:56.309172 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Returning 404 to user: Instance 75145055-cbf0-4840-b4fc-a2907f7b8f1c could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:52:56.309172 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-758c0a4b-108a-4e65-8f9c-5868dc2a0792 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c" status: 404 len: 111 microversion: 2.20 time: 0.036113 Aug 24 16:52:56.309172 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 485/964] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:56 2022] GET /compute/v2.1/servers/75145055-cbf0-4840-b4fc-a2907f7b8f1c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:52:56.627002 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:52:56.627587 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:52:56.628480 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:52:56.629157 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:52:56.630047 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:52:56.648409 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:56.649495 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:56.650762 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:56.651842 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:56.652330 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:56.652801 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:56.676450 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Getting quotas for project 19ee69068eb94cf1b4a0d78f7d5e4a8b. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:52:56.682791 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Getting quotas for user 651140ed5a704cde978be56393e0537e and project 19ee69068eb94cf1b4a0d78f7d5e4a8b. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:52:56.706989 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:52:56.709733 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:52:56.875204 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fa999be5-3d1d-4310-85de-b50e99cea2f0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816326 Aug 24 16:52:56.876142 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 480/965] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:52:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:52:56.896462 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a59b3ba1-30a3-4d13-8cae-14b9a066d633 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:56.897982 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a59b3ba1-30a3-4d13-8cae-14b9a066d633 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:56.975288 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a59b3ba1-30a3-4d13-8cae-14b9a066d633 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:56.992394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a59b3ba1-30a3-4d13-8cae-14b9a066d633 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1214 microversion: 2.1 time: 0.099705 Aug 24 16:52:56.992394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 486/966] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:56 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:57.889556 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:57.889556 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:57.896923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.897504 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.897961 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.898706 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.899169 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.899595 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.918589 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] HTTP exception thrown: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Request method failure captured: Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 HTTP/1.1 Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlW3A2Z4Gr_7m650eNJevLJRwbdj-fG2G0izi-msGweQQMpanIoQFLiISwhTFLNi7XwTHBav_tdxfj7Ld1MD8TgKaUpzaps9Mwe7dKyHDEW8OUcaTcnw3G4YawdFoTHGNr0Q8Ceu8U0lE7BrBT3YWOmUd6UcPMMKOxjWrxN4GX3EENE Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:52:57.919923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_52f30f320fa04cdfa0e1d4ea9050119c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: fc27435df46542a3ac37e743b6399387 Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:52:57.922395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '1eadb4fd-bee8-4fac-b072-550b720e3e95'} Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:52:57.923829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:52:57.926057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:52:57.929492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Returning 404 to user: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:52:57.929492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-71f0dfbd-5fcf-426c-afa0-099dd7d32cdc tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 404 len: 111 microversion: 2.20 time: 0.037704 Aug 24 16:52:57.929492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 481/967] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 24 16:52:57 2022] DELETE /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 16:52:57.933959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:57.934922 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] [instance: 1eadb4fd-bee8-4fac-b072-550b720e3e95] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:57.942937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.943493 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.944883 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.945205 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.945662 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.946094 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.961241 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] HTTP exception thrown: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Request method failure captured: Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 HTTP/1.1 Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBlW3A2Z4Gr_7m650eNJevLJRwbdj-fG2G0izi-msGweQQMpanIoQFLiISwhTFLNi7XwTHBav_tdxfj7Ld1MD8TgKaUpzaps9Mwe7dKyHDEW8OUcaTcnw3G4YawdFoTHGNr0Q8Ceu8U0lE7BrBT3YWOmUd6UcPMMKOxjWrxN4GX3EENE Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:52:57.963103 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_52f30f320fa04cdfa0e1d4ea9050119c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52f30f320fa04cdfa0e1d4ea9050119c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 52f30f320fa04cdfa0e1d4ea9050119c Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-903958706 Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: fc27435df46542a3ac37e743b6399387 Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-AttachVolumeShelveTestJSON-903958706-project Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:52:57.965620 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '1eadb4fd-bee8-4fac-b072-550b720e3e95'} Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:52:57.969110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. Aug 24 16:52:57.974567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:52:57.976807 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] Returning 404 to user: Instance 1eadb4fd-bee8-4fac-b072-550b720e3e95 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:52:57.976807 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b594f89e-2f6b-4445-82f3-3b7dbc3f5af8 tempest-AttachVolumeShelveTestJSON-903958706 tempest-AttachVolumeShelveTestJSON-903958706-project] 10.222.0.17 "GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95" status: 404 len: 111 microversion: 2.20 time: 0.036187 Aug 24 16:52:57.976807 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 487/968] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:57 2022] GET /compute/v2.1/servers/1eadb4fd-bee8-4fac-b072-550b720e3e95 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 16:52:58.020033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-da99e595-f323-47d4-83d0-308cd3df1362 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:58.021489 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-da99e595-f323-47d4-83d0-308cd3df1362 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:58.171546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-da99e595-f323-47d4-83d0-308cd3df1362 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:58.179998 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-da99e595-f323-47d4-83d0-308cd3df1362 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1214 microversion: 2.1 time: 0.168362 Aug 24 16:52:58.192511 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 482/969] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:58 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:59.206937 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e70111e4-26e0-473e-8a7a-22a7d4281c1a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:59.207719 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e70111e4-26e0-473e-8a7a-22a7d4281c1a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:59.215292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e70111e4-26e0-473e-8a7a-22a7d4281c1a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:59.215899 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e70111e4-26e0-473e-8a7a-22a7d4281c1a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:59.216443 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e70111e4-26e0-473e-8a7a-22a7d4281c1a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:59.217158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e70111e4-26e0-473e-8a7a-22a7d4281c1a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:59.217617 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e70111e4-26e0-473e-8a7a-22a7d4281c1a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:59.218041 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e70111e4-26e0-473e-8a7a-22a7d4281c1a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:59.310758 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e70111e4-26e0-473e-8a7a-22a7d4281c1a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:59.321221 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e70111e4-26e0-473e-8a7a-22a7d4281c1a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1218 microversion: 2.1 time: 0.117834 Aug 24 16:52:59.324199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 488/970] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:59 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:00.346627 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-53f79172-d8f9-4e89-927f-dabeef87edd7 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:00.349276 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-53f79172-d8f9-4e89-927f-dabeef87edd7 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:00.359023 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f79172-d8f9-4e89-927f-dabeef87edd7 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:00.361493 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f79172-d8f9-4e89-927f-dabeef87edd7 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:00.361493 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f79172-d8f9-4e89-927f-dabeef87edd7 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:00.361493 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f79172-d8f9-4e89-927f-dabeef87edd7 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:00.361493 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f79172-d8f9-4e89-927f-dabeef87edd7 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:00.362065 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f79172-d8f9-4e89-927f-dabeef87edd7 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:00.445431 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-53f79172-d8f9-4e89-927f-dabeef87edd7 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:00.455388 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-53f79172-d8f9-4e89-927f-dabeef87edd7 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1218 microversion: 2.1 time: 0.115501 Aug 24 16:53:00.456004 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 483/971] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:00 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:53:01.483335 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-179c3bc4-459e-432d-b2e5-b50e6a4557ab tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:01.484423 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-179c3bc4-459e-432d-b2e5-b50e6a4557ab tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:01.500640 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-179c3bc4-459e-432d-b2e5-b50e6a4557ab tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:01.500640 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-179c3bc4-459e-432d-b2e5-b50e6a4557ab tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:01.500640 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-179c3bc4-459e-432d-b2e5-b50e6a4557ab tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:01.500640 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-179c3bc4-459e-432d-b2e5-b50e6a4557ab tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:01.501366 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-179c3bc4-459e-432d-b2e5-b50e6a4557ab tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:01.501366 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-179c3bc4-459e-432d-b2e5-b50e6a4557ab tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:01.609907 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-179c3bc4-459e-432d-b2e5-b50e6a4557ab tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:01.621530 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-179c3bc4-459e-432d-b2e5-b50e6a4557ab tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1218 microversion: 2.1 time: 0.146208 Aug 24 16:53:01.622632 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 489/972] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:01 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:02.649429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b54d5adf-51f9-4ba4-b981-2804bb3ecf2b tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:02.652165 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b54d5adf-51f9-4ba4-b981-2804bb3ecf2b tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:02.663672 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b54d5adf-51f9-4ba4-b981-2804bb3ecf2b tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:02.664566 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b54d5adf-51f9-4ba4-b981-2804bb3ecf2b tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:02.666856 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b54d5adf-51f9-4ba4-b981-2804bb3ecf2b tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:02.666856 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b54d5adf-51f9-4ba4-b981-2804bb3ecf2b tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:02.666856 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b54d5adf-51f9-4ba4-b981-2804bb3ecf2b tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:02.667948 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b54d5adf-51f9-4ba4-b981-2804bb3ecf2b tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:02.797232 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b54d5adf-51f9-4ba4-b981-2804bb3ecf2b tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:02.811039 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b54d5adf-51f9-4ba4-b981-2804bb3ecf2b tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1266 microversion: 2.1 time: 0.170511 Aug 24 16:53:02.812072 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 484/973] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:02 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:03.835980 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8c47b468-3e96-46ff-9daf-0df020f9d373 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:03.837333 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8c47b468-3e96-46ff-9daf-0df020f9d373 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:03.845015 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c47b468-3e96-46ff-9daf-0df020f9d373 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:03.845739 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c47b468-3e96-46ff-9daf-0df020f9d373 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:03.846332 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c47b468-3e96-46ff-9daf-0df020f9d373 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:03.847068 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c47b468-3e96-46ff-9daf-0df020f9d373 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:03.847582 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c47b468-3e96-46ff-9daf-0df020f9d373 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:03.848206 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8c47b468-3e96-46ff-9daf-0df020f9d373 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:03.933583 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8c47b468-3e96-46ff-9daf-0df020f9d373 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:03.950220 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8c47b468-3e96-46ff-9daf-0df020f9d373 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1272 microversion: 2.1 time: 0.119195 Aug 24 16:53:03.971704 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 490/974] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:03 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:53:04.985015 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a5a1fcb3-780c-4647-ae71-5ddcc8d6b3b0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:04.986247 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a5a1fcb3-780c-4647-ae71-5ddcc8d6b3b0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:04.993785 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5a1fcb3-780c-4647-ae71-5ddcc8d6b3b0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:04.994268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5a1fcb3-780c-4647-ae71-5ddcc8d6b3b0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:04.994698 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5a1fcb3-780c-4647-ae71-5ddcc8d6b3b0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:04.995391 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5a1fcb3-780c-4647-ae71-5ddcc8d6b3b0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:04.995841 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5a1fcb3-780c-4647-ae71-5ddcc8d6b3b0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:04.996511 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5a1fcb3-780c-4647-ae71-5ddcc8d6b3b0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:05.516245 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a5a1fcb3-780c-4647-ae71-5ddcc8d6b3b0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:05.527524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a5a1fcb3-780c-4647-ae71-5ddcc8d6b3b0 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1314 microversion: 2.1 time: 0.546235 Aug 24 16:53:05.528119 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 485/975] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:04 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:05.626711 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-7877354d-2514-43b9-9293-1e3c60a810a2 req-ce653ace-fcd2-4d4b-97dc-d2d87c374a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15b20db-55b3-45d3-9773-a995c9a8b671", "tag": "13afb47f-6208-45eb-8cc9-98a96b0dfcb5"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:05.642612 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-7877354d-2514-43b9-9293-1e3c60a810a2 req-ce653ace-fcd2-4d4b-97dc-d2d87c374a23 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:05.643440 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-7877354d-2514-43b9-9293-1e3c60a810a2 req-ce653ace-fcd2-4d4b-97dc-d2d87c374a23 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:05.644122 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-7877354d-2514-43b9-9293-1e3c60a810a2 req-ce653ace-fcd2-4d4b-97dc-d2d87c374a23 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:05.674702 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-7877354d-2514-43b9-9293-1e3c60a810a2 req-ce653ace-fcd2-4d4b-97dc-d2d87c374a23 service nova] Creating event network-changed:13afb47f-6208-45eb-8cc9-98a96b0dfcb5 for instance a15b20db-55b3-45d3-9773-a995c9a8b671 on hv-cinder-73116 Aug 24 16:53:05.684200 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-7877354d-2514-43b9-9293-1e3c60a810a2 req-ce653ace-fcd2-4d4b-97dc-d2d87c374a23 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063423 Aug 24 16:53:05.687920 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 491/976] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:06.563386 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6bcb12aa-ae3d-4e35-906f-d3d01c570db9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:06.566106 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6bcb12aa-ae3d-4e35-906f-d3d01c570db9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:06.572874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6bcb12aa-ae3d-4e35-906f-d3d01c570db9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:06.573432 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6bcb12aa-ae3d-4e35-906f-d3d01c570db9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:06.573983 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6bcb12aa-ae3d-4e35-906f-d3d01c570db9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:06.574946 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6bcb12aa-ae3d-4e35-906f-d3d01c570db9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:06.575714 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6bcb12aa-ae3d-4e35-906f-d3d01c570db9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:06.576519 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6bcb12aa-ae3d-4e35-906f-d3d01c570db9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:06.668879 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:06.778172 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6bcb12aa-ae3d-4e35-906f-d3d01c570db9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:06.787276 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6bcb12aa-ae3d-4e35-906f-d3d01c570db9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1314 microversion: 2.1 time: 0.229105 Aug 24 16:53:06.809188 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 486/977] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:06 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:06.877082 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1877496288", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1100356887", "security_groups": [{"name": "tempest-secgroup-smoke-1875641850"}], "block_device_mapping_v2": [{"uuid": "62bcd9e7-384d-4cf3-8d95-6ebd3527b4a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a598ee64-8390-470b-8704-7686a7a90fa6"}]}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:06.979799 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:07.053839 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.network.neutron [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] validate_networks() for [('a598ee64-8390-470b-8704-7686a7a90fa6', None, None, None, None, None)] {{(pid=127626) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:53:07.672828 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Flavor limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:53:07.672828 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Image limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:53:07.673095 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Flavor pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:53:07.673525 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Image pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:53:07.673961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:53:07.684685 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:07.685175 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:07.685607 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:07.686515 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:07.687140 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:07.687563 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:07.705134 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Getting quotas for project f18db8d724d4436cb1721859066ac74d. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:53:07.710539 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Getting quotas for user aaa4ddbee1034946a1f4dfe751a2b5cd and project f18db8d724d4436cb1721859066ac74d. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:53:07.785436 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Going to run 1 instances... {{(pid=127626) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:53:07.791231 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62bcd9e7-384d-4cf3-8d95-6ebd3527b4a6',volume_size=None,volume_type=None)] {{(pid=127626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:53:07.819665 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-129ecc49-bc0d-413d-8870-b65333bccbce tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:07.820679 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-129ecc49-bc0d-413d-8870-b65333bccbce tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:07.834327 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-129ecc49-bc0d-413d-8870-b65333bccbce tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:07.836135 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-129ecc49-bc0d-413d-8870-b65333bccbce tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:07.836887 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-129ecc49-bc0d-413d-8870-b65333bccbce tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:07.840850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-129ecc49-bc0d-413d-8870-b65333bccbce tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:07.840850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-129ecc49-bc0d-413d-8870-b65333bccbce tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:07.840850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-129ecc49-bc0d-413d-8870-b65333bccbce tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:08.053449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-129ecc49-bc0d-413d-8870-b65333bccbce tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:08.062414 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-129ecc49-bc0d-413d-8870-b65333bccbce tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1314 microversion: 2.1 time: 0.249872 Aug 24 16:53:08.063002 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 487/978] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:07 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:08.409198 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c4fc413b-1a7f-4efe-bd1a-a0db8c066a2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.538054 Aug 24 16:53:08.410075 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 492/979] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:53:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:53:08.424388 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-32d46989-827e-4b31-9171-428fff19b1f2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:08.425022 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-32d46989-827e-4b31-9171-428fff19b1f2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:08.434032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=8 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:08.493413 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-32d46989-827e-4b31-9171-428fff19b1f2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:08.502467 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-32d46989-827e-4b31-9171-428fff19b1f2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1095 microversion: 2.1 time: 0.081907 Aug 24 16:53:08.503402 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 488/980] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:08 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:09.085865 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2555fc02-9dee-443d-b88f-e13f9f236165 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:09.086843 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2555fc02-9dee-443d-b88f-e13f9f236165 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:09.104782 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2555fc02-9dee-443d-b88f-e13f9f236165 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:09.107054 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2555fc02-9dee-443d-b88f-e13f9f236165 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:09.107827 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2555fc02-9dee-443d-b88f-e13f9f236165 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:09.108882 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2555fc02-9dee-443d-b88f-e13f9f236165 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:09.109695 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2555fc02-9dee-443d-b88f-e13f9f236165 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:09.110561 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2555fc02-9dee-443d-b88f-e13f9f236165 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:09.348475 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2555fc02-9dee-443d-b88f-e13f9f236165 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:09.357727 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2555fc02-9dee-443d-b88f-e13f9f236165 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1314 microversion: 2.1 time: 0.276529 Aug 24 16:53:09.361970 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 493/981] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:09 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:53:09.526721 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0a5129a0-4636-48eb-ba26-26c4df432433 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:09.527631 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0a5129a0-4636-48eb-ba26-26c4df432433 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:09.614069 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0a5129a0-4636-48eb-ba26-26c4df432433 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:09.623197 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0a5129a0-4636-48eb-ba26-26c4df432433 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1095 microversion: 2.1 time: 0.100473 Aug 24 16:53:09.638983 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 489/982] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:09 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1095 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:10.389186 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-03b13c08-34d8-4e1f-814f-2f330b343fc8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:10.391789 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-03b13c08-34d8-4e1f-814f-2f330b343fc8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:10.413559 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03b13c08-34d8-4e1f-814f-2f330b343fc8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:10.418837 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03b13c08-34d8-4e1f-814f-2f330b343fc8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:10.418837 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03b13c08-34d8-4e1f-814f-2f330b343fc8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:10.418837 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03b13c08-34d8-4e1f-814f-2f330b343fc8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:10.418837 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03b13c08-34d8-4e1f-814f-2f330b343fc8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:10.419467 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-03b13c08-34d8-4e1f-814f-2f330b343fc8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:10.646897 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-03b13c08-34d8-4e1f-814f-2f330b343fc8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:10.652058 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-19d0f5d4-31e3-4d1f-8d7b-3e571b406ce2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:10.654317 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-19d0f5d4-31e3-4d1f-8d7b-3e571b406ce2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:10.661590 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-03b13c08-34d8-4e1f-814f-2f330b343fc8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1314 microversion: 2.1 time: 0.279788 Aug 24 16:53:10.663245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 494/983] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:10 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:10.666076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19d0f5d4-31e3-4d1f-8d7b-3e571b406ce2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:10.666655 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19d0f5d4-31e3-4d1f-8d7b-3e571b406ce2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:10.667167 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19d0f5d4-31e3-4d1f-8d7b-3e571b406ce2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:10.668076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19d0f5d4-31e3-4d1f-8d7b-3e571b406ce2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:10.669331 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19d0f5d4-31e3-4d1f-8d7b-3e571b406ce2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:10.670539 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19d0f5d4-31e3-4d1f-8d7b-3e571b406ce2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:10.784066 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-19d0f5d4-31e3-4d1f-8d7b-3e571b406ce2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:10.793252 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-19d0f5d4-31e3-4d1f-8d7b-3e571b406ce2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1137 microversion: 2.1 time: 0.149894 Aug 24 16:53:10.794095 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 490/984] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:10 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1137 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:11.230375 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-e061a6dd-d17c-4320-8a5f-a245e95e5095 req-857bcb40-318c-4257-b368-1373ee2fe375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15b20db-55b3-45d3-9773-a995c9a8b671", "name": "network-vif-plugged", "status": "completed", "tag": "13afb47f-6208-45eb-8cc9-98a96b0dfcb5"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:11.241863 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-e061a6dd-d17c-4320-8a5f-a245e95e5095 req-857bcb40-318c-4257-b368-1373ee2fe375 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:11.242384 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-e061a6dd-d17c-4320-8a5f-a245e95e5095 req-857bcb40-318c-4257-b368-1373ee2fe375 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:11.242808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-e061a6dd-d17c-4320-8a5f-a245e95e5095 req-857bcb40-318c-4257-b368-1373ee2fe375 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:11.254555 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-e061a6dd-d17c-4320-8a5f-a245e95e5095 req-857bcb40-318c-4257-b368-1373ee2fe375 service nova] Creating event network-vif-plugged:13afb47f-6208-45eb-8cc9-98a96b0dfcb5 for instance a15b20db-55b3-45d3-9773-a995c9a8b671 on hv-cinder-73116 Aug 24 16:53:11.260517 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-e061a6dd-d17c-4320-8a5f-a245e95e5095 req-857bcb40-318c-4257-b368-1373ee2fe375 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035109 Aug 24 16:53:11.261129 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 495/985] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:11.684825 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-919db64c-5a47-49c1-8257-61c950ce8e1c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:11.686499 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-919db64c-5a47-49c1-8257-61c950ce8e1c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:11.694792 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-919db64c-5a47-49c1-8257-61c950ce8e1c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:11.695737 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-919db64c-5a47-49c1-8257-61c950ce8e1c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:11.696579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-919db64c-5a47-49c1-8257-61c950ce8e1c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:11.699864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-919db64c-5a47-49c1-8257-61c950ce8e1c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:11.699864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-919db64c-5a47-49c1-8257-61c950ce8e1c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:11.699864 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-919db64c-5a47-49c1-8257-61c950ce8e1c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:11.827632 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9e5ce6d5-5874-4c52-aeff-08ecd080a309 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:11.829984 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9e5ce6d5-5874-4c52-aeff-08ecd080a309 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:11.850355 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9e5ce6d5-5874-4c52-aeff-08ecd080a309 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:11.850930 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9e5ce6d5-5874-4c52-aeff-08ecd080a309 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:11.851674 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9e5ce6d5-5874-4c52-aeff-08ecd080a309 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:11.853158 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9e5ce6d5-5874-4c52-aeff-08ecd080a309 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:11.853832 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9e5ce6d5-5874-4c52-aeff-08ecd080a309 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:11.854750 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9e5ce6d5-5874-4c52-aeff-08ecd080a309 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:12.005228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9e5ce6d5-5874-4c52-aeff-08ecd080a309 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:12.013915 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9e5ce6d5-5874-4c52-aeff-08ecd080a309 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1201 microversion: 2.1 time: 0.191717 Aug 24 16:53:12.014622 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 496/986] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:11 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1201 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:53:12.148785 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-919db64c-5a47-49c1-8257-61c950ce8e1c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:12.172716 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-919db64c-5a47-49c1-8257-61c950ce8e1c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1314 microversion: 2.1 time: 0.492717 Aug 24 16:53:12.173647 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 491/987] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:11 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:13.047264 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-dce59e69-3a85-428b-9d3f-2bc2a39db97a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:13.047889 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-dce59e69-3a85-428b-9d3f-2bc2a39db97a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:13.054646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce59e69-3a85-428b-9d3f-2bc2a39db97a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:13.055121 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce59e69-3a85-428b-9d3f-2bc2a39db97a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:13.055557 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce59e69-3a85-428b-9d3f-2bc2a39db97a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:13.056258 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce59e69-3a85-428b-9d3f-2bc2a39db97a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:13.056742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce59e69-3a85-428b-9d3f-2bc2a39db97a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:13.057217 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-dce59e69-3a85-428b-9d3f-2bc2a39db97a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:13.195176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9d7a3b8b-cada-4d91-924a-fb47e17206b8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:13.196001 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9d7a3b8b-cada-4d91-924a-fb47e17206b8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:13.201552 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:13.211226 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d7a3b8b-cada-4d91-924a-fb47e17206b8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:13.211738 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d7a3b8b-cada-4d91-924a-fb47e17206b8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:13.212190 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d7a3b8b-cada-4d91-924a-fb47e17206b8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:13.212961 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d7a3b8b-cada-4d91-924a-fb47e17206b8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:13.213429 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d7a3b8b-cada-4d91-924a-fb47e17206b8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:13.213865 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9d7a3b8b-cada-4d91-924a-fb47e17206b8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:13.228214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=83 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:13.452749 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-dce59e69-3a85-428b-9d3f-2bc2a39db97a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:13.485143 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-dce59e69-3a85-428b-9d3f-2bc2a39db97a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1279 microversion: 2.1 time: 0.434383 Aug 24 16:53:13.485143 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 497/988] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:13 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1279 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:13.491627 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9d7a3b8b-cada-4d91-924a-fb47e17206b8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:13.505404 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9d7a3b8b-cada-4d91-924a-fb47e17206b8 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1314 microversion: 2.1 time: 0.314525 Aug 24 16:53:13.508484 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 492/989] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:13 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:14.514026 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-741f008a-95ed-4b73-9b8b-39488be5717b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:14.514026 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-741f008a-95ed-4b73-9b8b-39488be5717b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:14.523002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-741f008a-95ed-4b73-9b8b-39488be5717b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:14.523972 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-741f008a-95ed-4b73-9b8b-39488be5717b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:14.525968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-741f008a-95ed-4b73-9b8b-39488be5717b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:14.525968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-741f008a-95ed-4b73-9b8b-39488be5717b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:14.525968 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-741f008a-95ed-4b73-9b8b-39488be5717b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:14.526556 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-741f008a-95ed-4b73-9b8b-39488be5717b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:14.538466 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f21c70d6-2c22-412d-ae3e-bd50aefc2573 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:14.544620 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f21c70d6-2c22-412d-ae3e-bd50aefc2573 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:14.554124 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f21c70d6-2c22-412d-ae3e-bd50aefc2573 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:14.556177 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f21c70d6-2c22-412d-ae3e-bd50aefc2573 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:14.557356 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f21c70d6-2c22-412d-ae3e-bd50aefc2573 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:14.562807 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f21c70d6-2c22-412d-ae3e-bd50aefc2573 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:14.563312 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f21c70d6-2c22-412d-ae3e-bd50aefc2573 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:14.564300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f21c70d6-2c22-412d-ae3e-bd50aefc2573 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:14.831972 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-741f008a-95ed-4b73-9b8b-39488be5717b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:14.835747 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:14.844024 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f21c70d6-2c22-412d-ae3e-bd50aefc2573 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:14.847642 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-741f008a-95ed-4b73-9b8b-39488be5717b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1267 microversion: 2.1 time: 0.332272 Aug 24 16:53:14.854303 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 498/990] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:14 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1267 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:14.859449 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-fdeef0a6-4a6b-412d-b717-ef17cdf006a7 req-98111f44-0426-4ae1-a1fe-b812af345e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebd3320-a313-4dca-ba4b-d104b45402bb", "tag": "743286c8-2c3d-444d-ae91-8875dcf1827d"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:14.860685 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f21c70d6-2c22-412d-ae3e-bd50aefc2573 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1497 microversion: 2.1 time: 0.324991 Aug 24 16:53:14.861350 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 493/991] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:14 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1497 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:14.873207 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:14.883706 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-fdeef0a6-4a6b-412d-b717-ef17cdf006a7 req-98111f44-0426-4ae1-a1fe-b812af345e4f service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:14.883706 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-fdeef0a6-4a6b-412d-b717-ef17cdf006a7 req-98111f44-0426-4ae1-a1fe-b812af345e4f service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:14.884321 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-fdeef0a6-4a6b-412d-b717-ef17cdf006a7 req-98111f44-0426-4ae1-a1fe-b812af345e4f service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:14.904070 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-fdeef0a6-4a6b-412d-b717-ef17cdf006a7 req-98111f44-0426-4ae1-a1fe-b812af345e4f service nova] Creating event network-changed:743286c8-2c3d-444d-ae91-8875dcf1827d for instance 3ebd3320-a313-4dca-ba4b-d104b45402bb on hv-cinder-73116 Aug 24 16:53:14.911083 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-fdeef0a6-4a6b-412d-b717-ef17cdf006a7 req-98111f44-0426-4ae1-a1fe-b812af345e4f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054620 Aug 24 16:53:14.912090 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 499/992] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:15.880651 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-479a8624-6282-4484-9c03-c6bcd509605a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:15.882494 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-479a8624-6282-4484-9c03-c6bcd509605a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:15.892452 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-479a8624-6282-4484-9c03-c6bcd509605a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:15.893261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-479a8624-6282-4484-9c03-c6bcd509605a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:15.893938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-479a8624-6282-4484-9c03-c6bcd509605a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:15.895388 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-479a8624-6282-4484-9c03-c6bcd509605a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:15.897119 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-479a8624-6282-4484-9c03-c6bcd509605a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:15.898226 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-479a8624-6282-4484-9c03-c6bcd509605a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:15.924438 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-10ed60b7-1ec6-40de-9970-271ac0423f49 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:15.926335 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-10ed60b7-1ec6-40de-9970-271ac0423f49 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:15.948596 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-10ed60b7-1ec6-40de-9970-271ac0423f49 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:15.948596 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-10ed60b7-1ec6-40de-9970-271ac0423f49 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:15.948596 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-10ed60b7-1ec6-40de-9970-271ac0423f49 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:15.948596 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-10ed60b7-1ec6-40de-9970-271ac0423f49 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:15.949220 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-10ed60b7-1ec6-40de-9970-271ac0423f49 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:15.949805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-10ed60b7-1ec6-40de-9970-271ac0423f49 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:15.985695 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-10ed60b7-1ec6-40de-9970-271ac0423f49 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Going to try to terminate instance {{(pid=127626) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:53:16.200138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-479a8624-6282-4484-9c03-c6bcd509605a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:16.216238 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-479a8624-6282-4484-9c03-c6bcd509605a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1267 microversion: 2.1 time: 0.339494 Aug 24 16:53:16.218524 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 494/993] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:15 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1267 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:16.382799 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-10ed60b7-1ec6-40de-9970-271ac0423f49 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 204 len: 0 microversion: 2.1 time: 0.464950 Aug 24 16:53:16.384900 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 500/994] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:53:15 2022] DELETE /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:53:16.398144 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d145a84f-9b64-459f-8d70-89afd4268bfd tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:16.398850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d145a84f-9b64-459f-8d70-89afd4268bfd tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:16.408118 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d145a84f-9b64-459f-8d70-89afd4268bfd tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:16.408955 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d145a84f-9b64-459f-8d70-89afd4268bfd tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:16.409705 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d145a84f-9b64-459f-8d70-89afd4268bfd tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:16.411013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d145a84f-9b64-459f-8d70-89afd4268bfd tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:16.412033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d145a84f-9b64-459f-8d70-89afd4268bfd tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:16.413322 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d145a84f-9b64-459f-8d70-89afd4268bfd tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:16.585908 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d145a84f-9b64-459f-8d70-89afd4268bfd tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:16.593655 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d145a84f-9b64-459f-8d70-89afd4268bfd tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1503 microversion: 2.1 time: 0.202530 Aug 24 16:53:16.594216 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 495/995] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:16 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:17.244035 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-66cb7438-e15e-445e-b82a-ba952c8a0e44 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:17.244035 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-66cb7438-e15e-445e-b82a-ba952c8a0e44 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:17.249452 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-66cb7438-e15e-445e-b82a-ba952c8a0e44 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:17.249943 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-66cb7438-e15e-445e-b82a-ba952c8a0e44 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:17.250378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-66cb7438-e15e-445e-b82a-ba952c8a0e44 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:17.251283 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-66cb7438-e15e-445e-b82a-ba952c8a0e44 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:17.251898 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-66cb7438-e15e-445e-b82a-ba952c8a0e44 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:17.252528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-66cb7438-e15e-445e-b82a-ba952c8a0e44 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:17.415399 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-66cb7438-e15e-445e-b82a-ba952c8a0e44 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:17.424063 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-66cb7438-e15e-445e-b82a-ba952c8a0e44 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1267 microversion: 2.1 time: 0.188303 Aug 24 16:53:17.424942 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 501/996] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:17 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:17.614967 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-99b43002-c274-4a3b-a827-c36042068e8f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:17.616507 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-99b43002-c274-4a3b-a827-c36042068e8f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:17.623060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99b43002-c274-4a3b-a827-c36042068e8f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:17.623557 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99b43002-c274-4a3b-a827-c36042068e8f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:17.623994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99b43002-c274-4a3b-a827-c36042068e8f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:17.624933 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99b43002-c274-4a3b-a827-c36042068e8f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:17.625472 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99b43002-c274-4a3b-a827-c36042068e8f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:17.625998 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-99b43002-c274-4a3b-a827-c36042068e8f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:17.789469 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-99b43002-c274-4a3b-a827-c36042068e8f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:17.798531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-99b43002-c274-4a3b-a827-c36042068e8f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1503 microversion: 2.1 time: 0.187195 Aug 24 16:53:17.799115 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 496/997] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:17 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:18.446575 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a6763244-3a6f-4b7d-8087-51d14a432fcd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:18.447811 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a6763244-3a6f-4b7d-8087-51d14a432fcd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:18.450795 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:18.451500 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=6 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:18.458611 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a6763244-3a6f-4b7d-8087-51d14a432fcd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:18.459133 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a6763244-3a6f-4b7d-8087-51d14a432fcd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:18.460364 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a6763244-3a6f-4b7d-8087-51d14a432fcd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:18.461251 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a6763244-3a6f-4b7d-8087-51d14a432fcd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:18.461885 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a6763244-3a6f-4b7d-8087-51d14a432fcd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:18.462574 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a6763244-3a6f-4b7d-8087-51d14a432fcd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:18.643094 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a6763244-3a6f-4b7d-8087-51d14a432fcd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:18.653533 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a6763244-3a6f-4b7d-8087-51d14a432fcd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1267 microversion: 2.1 time: 0.212463 Aug 24 16:53:18.654110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 502/998] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:18 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:18.787168 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-5fc9344f-d678-41c8-9f88-c06f6f0e3c46 req-a76440bf-e9c2-45af-93ea-58a3373c861d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15b20db-55b3-45d3-9773-a995c9a8b671", "name": "network-vif-deleted", "tag": "13afb47f-6208-45eb-8cc9-98a96b0dfcb5"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:18.798921 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5fc9344f-d678-41c8-9f88-c06f6f0e3c46 req-a76440bf-e9c2-45af-93ea-58a3373c861d service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:18.799292 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5fc9344f-d678-41c8-9f88-c06f6f0e3c46 req-a76440bf-e9c2-45af-93ea-58a3373c861d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:18.799722 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5fc9344f-d678-41c8-9f88-c06f6f0e3c46 req-a76440bf-e9c2-45af-93ea-58a3373c861d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:18.813806 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-5fc9344f-d678-41c8-9f88-c06f6f0e3c46 req-a76440bf-e9c2-45af-93ea-58a3373c861d service nova] Creating event network-vif-deleted:13afb47f-6208-45eb-8cc9-98a96b0dfcb5 for instance a15b20db-55b3-45d3-9773-a995c9a8b671 on hv-cinder-73116 Aug 24 16:53:18.822561 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8bc0de50-3c2c-4f2c-bbce-c6eea8414a4a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:18.822561 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8bc0de50-3c2c-4f2c-bbce-c6eea8414a4a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:18.826630 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-5fc9344f-d678-41c8-9f88-c06f6f0e3c46 req-a76440bf-e9c2-45af-93ea-58a3373c861d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043890 Aug 24 16:53:18.828648 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bc0de50-3c2c-4f2c-bbce-c6eea8414a4a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:18.829136 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bc0de50-3c2c-4f2c-bbce-c6eea8414a4a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:18.830155 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bc0de50-3c2c-4f2c-bbce-c6eea8414a4a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:18.833385 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bc0de50-3c2c-4f2c-bbce-c6eea8414a4a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:18.833935 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 497/999] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:18.834063 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bc0de50-3c2c-4f2c-bbce-c6eea8414a4a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:18.834063 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8bc0de50-3c2c-4f2c-bbce-c6eea8414a4a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:18.914869 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8bc0de50-3c2c-4f2c-bbce-c6eea8414a4a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:18.930029 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8bc0de50-3c2c-4f2c-bbce-c6eea8414a4a tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1461 microversion: 2.1 time: 0.112265 Aug 24 16:53:18.931468 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 503/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:18 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1461 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:53:19.674937 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=4 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:19.680328 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1766a2b9-188e-4d38-a75c-7efc5d07d51e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:19.681063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1766a2b9-188e-4d38-a75c-7efc5d07d51e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:19.687366 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1766a2b9-188e-4d38-a75c-7efc5d07d51e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:19.687860 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1766a2b9-188e-4d38-a75c-7efc5d07d51e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:19.688296 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1766a2b9-188e-4d38-a75c-7efc5d07d51e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:19.689035 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1766a2b9-188e-4d38-a75c-7efc5d07d51e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:19.689491 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1766a2b9-188e-4d38-a75c-7efc5d07d51e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:19.689968 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1766a2b9-188e-4d38-a75c-7efc5d07d51e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:19.882183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1766a2b9-188e-4d38-a75c-7efc5d07d51e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:19.892215 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1766a2b9-188e-4d38-a75c-7efc5d07d51e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1267 microversion: 2.1 time: 0.219640 Aug 24 16:53:19.895270 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 498/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:19 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:19.957916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:19.958908 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:19.967187 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:19.967685 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:19.968126 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:19.968893 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:19.969353 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:19.969782 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:20.011433 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:20.011929 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:20.012447 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:20.013151 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lazy-loading 'fault' on Instance uuid a15b20db-55b3-45d3-9773-a995c9a8b671 {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:53:20.057396 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:20.065608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-25c74b8a-5638-401e-bf1d-7d50c5d063f4 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 200 len: 1304 microversion: 2.1 time: 0.112580 Aug 24 16:53:20.066192 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 504/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:19 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:20.919709 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c8b998eb-2b97-4b9f-9f68-9d0c2bda10c4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:20.920382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c8b998eb-2b97-4b9f-9f68-9d0c2bda10c4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:20.927640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c8b998eb-2b97-4b9f-9f68-9d0c2bda10c4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:20.928303 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c8b998eb-2b97-4b9f-9f68-9d0c2bda10c4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:20.928788 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c8b998eb-2b97-4b9f-9f68-9d0c2bda10c4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:20.929488 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c8b998eb-2b97-4b9f-9f68-9d0c2bda10c4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:20.929944 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c8b998eb-2b97-4b9f-9f68-9d0c2bda10c4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:20.930359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c8b998eb-2b97-4b9f-9f68-9d0c2bda10c4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:21.088705 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:21.089324 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: a15b20db-55b3-45d3-9773-a995c9a8b671] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:21.090358 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c8b998eb-2b97-4b9f-9f68-9d0c2bda10c4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:21.096854 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:21.097824 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:21.107587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:21.107587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:21.107587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:21.107587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:21.108278 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c8b998eb-2b97-4b9f-9f68-9d0c2bda10c4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1267 microversion: 2.1 time: 0.192869 Aug 24 16:53:21.108278 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 499/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:20 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:21.116482 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] HTTP exception thrown: Instance a15b20db-55b3-45d3-9773-a995c9a8b671 could not be found. Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Request method failure captured: Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 HTTP/1.1 Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBldh5P7HawhZTdyjMbdK1QKf-RFYusdt0rBWGcCUoUFaLrITD75t5b6UjKABtrJm6niVC9MCqd-n86UxmdjSba3gh9F1_09A0Uy-_0FxSN8UTl8ApxqsXGJBIRPU1Xmqf-G3hu_qN9hiAlxI_5m2er-UHsWZCizIj9yo25nkf20RPoQ Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: 19ee69068eb94cf1b4a0d78f7d5e4a8b Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-VolumesActionsTest-289528995 Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:53:21.119764 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/19ee69068eb94cf1b4a0d78f7d5e4a8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/19ee69068eb94cf1b4a0d78f7d5e4a8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_19ee69068eb94cf1b4a0d78f7d5e4a8b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/19ee69068eb94cf1b4a0d78f7d5e4a8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-VolumesActionsTest-289528995 Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: 19ee69068eb94cf1b4a0d78f7d5e4a8b Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-VolumesActionsTest-289528995 Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-VolumesActionsTest-289528995-project Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: 651140ed5a704cde978be56393e0537e Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-VolumesActionsTest-289528995-project Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance a15b20db-55b3-45d3-9773-a995c9a8b671 could not be found. Aug 24 16:53:21.122226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': 'a15b20db-55b3-45d3-9773-a995c9a8b671'} Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15b20db-55b3-45d3-9773-a995c9a8b671 could not be found. Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:53:21.123174 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15b20db-55b3-45d3-9773-a995c9a8b671 could not be found. Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15b20db-55b3-45d3-9773-a995c9a8b671 could not be found. Aug 24 16:53:21.124579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:53:21.125972 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Returning 404 to user: Instance a15b20db-55b3-45d3-9773-a995c9a8b671 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:53:21.125972 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0de9a960-abf8-4ac3-b479-9a465b1dca52 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671" status: 404 len: 111 microversion: 2.1 time: 0.038379 Aug 24 16:53:21.134357 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 505/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:21 2022] GET /compute/v2.1/servers/a15b20db-55b3-45d3-9773-a995c9a8b671 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:53:21.247475 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1674760700", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "networks": [{"uuid": "60dfa6dd-f8ec-4f3a-84ef-367b2814b6c8"}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:21.312534 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] validate_networks() for [('60dfa6dd-f8ec-4f3a-84ef-367b2814b6c8', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:53:21.712091 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:53:21.712572 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:53:21.713175 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:53:21.713435 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:53:21.714033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:53:21.723901 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:21.724414 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:21.724870 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:21.726277 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:21.726750 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:21.727183 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:21.748489 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Getting quotas for project 19ee69068eb94cf1b4a0d78f7d5e4a8b. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:53:21.752198 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Getting quotas for user 651140ed5a704cde978be56393e0537e and project 19ee69068eb94cf1b4a0d78f7d5e4a8b. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:53:21.765602 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:53:21.768155 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:53:21.934571 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a924ad4c-93ef-4fc5-bf05-0fd79fd68abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690827 Aug 24 16:53:21.935620 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 500/1005] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:53:21.949078 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-4e26bd5a-fa9d-474e-b4bb-acdcae64b160 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:21.950463 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-4e26bd5a-fa9d-474e-b4bb-acdcae64b160 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:22.036360 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-4e26bd5a-fa9d-474e-b4bb-acdcae64b160 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:22.043805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-4e26bd5a-fa9d-474e-b4bb-acdcae64b160 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1214 microversion: 2.1 time: 0.098822 Aug 24 16:53:22.044806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 506/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:21 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:22.138498 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-55a07d3e-48cf-4383-a2eb-31bd6fce65cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:22.139248 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-55a07d3e-48cf-4383-a2eb-31bd6fce65cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:22.147720 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55a07d3e-48cf-4383-a2eb-31bd6fce65cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:22.148275 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55a07d3e-48cf-4383-a2eb-31bd6fce65cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:22.148710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55a07d3e-48cf-4383-a2eb-31bd6fce65cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:22.149432 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55a07d3e-48cf-4383-a2eb-31bd6fce65cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:22.149874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55a07d3e-48cf-4383-a2eb-31bd6fce65cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:22.150361 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-55a07d3e-48cf-4383-a2eb-31bd6fce65cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:22.341214 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-55a07d3e-48cf-4383-a2eb-31bd6fce65cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:22.356809 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-55a07d3e-48cf-4383-a2eb-31bd6fce65cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1267 microversion: 2.1 time: 0.222564 Aug 24 16:53:22.358500 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 501/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:22 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:23.067997 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3625c57f-f8e1-41f2-a3b2-e1105932b7ca tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:23.069325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3625c57f-f8e1-41f2-a3b2-e1105932b7ca tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:23.132002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3625c57f-f8e1-41f2-a3b2-e1105932b7ca tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:23.140988 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3625c57f-f8e1-41f2-a3b2-e1105932b7ca tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1214 microversion: 2.1 time: 0.076907 Aug 24 16:53:23.141988 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 507/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:23 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:23.383187 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-222f6caf-ad60-45e3-a118-39c11bb31def tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:23.384872 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-222f6caf-ad60-45e3-a118-39c11bb31def tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:23.391926 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-222f6caf-ad60-45e3-a118-39c11bb31def tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:23.392485 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-222f6caf-ad60-45e3-a118-39c11bb31def tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:23.393086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-222f6caf-ad60-45e3-a118-39c11bb31def tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:23.393836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-222f6caf-ad60-45e3-a118-39c11bb31def tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:23.394306 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-222f6caf-ad60-45e3-a118-39c11bb31def tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:23.394735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-222f6caf-ad60-45e3-a118-39c11bb31def tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:23.599001 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-222f6caf-ad60-45e3-a118-39c11bb31def tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:23.621080 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-222f6caf-ad60-45e3-a118-39c11bb31def tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1267 microversion: 2.1 time: 0.236434 Aug 24 16:53:23.621080 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 502/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:23 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:24.169681 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-80d7f890-f189-48b6-9928-ac3cf8cbf19d tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:24.170731 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-80d7f890-f189-48b6-9928-ac3cf8cbf19d tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:24.178754 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d7f890-f189-48b6-9928-ac3cf8cbf19d tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:24.187481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d7f890-f189-48b6-9928-ac3cf8cbf19d tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:24.187481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d7f890-f189-48b6-9928-ac3cf8cbf19d tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:24.187481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d7f890-f189-48b6-9928-ac3cf8cbf19d tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:24.187481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d7f890-f189-48b6-9928-ac3cf8cbf19d tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:24.187922 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-80d7f890-f189-48b6-9928-ac3cf8cbf19d tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:24.246199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-80d7f890-f189-48b6-9928-ac3cf8cbf19d tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:24.255965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-80d7f890-f189-48b6-9928-ac3cf8cbf19d tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1210 microversion: 2.1 time: 0.090005 Aug 24 16:53:24.255965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 508/1010] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:24 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:24.638411 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-92cf7ec7-55a5-452f-987a-131bcbb24f5b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:24.639022 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-92cf7ec7-55a5-452f-987a-131bcbb24f5b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:24.645949 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92cf7ec7-55a5-452f-987a-131bcbb24f5b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:24.646440 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92cf7ec7-55a5-452f-987a-131bcbb24f5b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:24.646927 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92cf7ec7-55a5-452f-987a-131bcbb24f5b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:24.647798 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92cf7ec7-55a5-452f-987a-131bcbb24f5b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:24.648258 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92cf7ec7-55a5-452f-987a-131bcbb24f5b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:24.648713 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92cf7ec7-55a5-452f-987a-131bcbb24f5b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:24.871159 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-92cf7ec7-55a5-452f-987a-131bcbb24f5b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:24.881302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-92cf7ec7-55a5-452f-987a-131bcbb24f5b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1267 microversion: 2.1 time: 0.246508 Aug 24 16:53:24.882877 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 503/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:24 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:25.287927 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-21299425-ecd5-4f22-8f91-c9165239cf65 req-c17b9695-75c5-4cf5-baaf-71359023dd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebd3320-a313-4dca-ba4b-d104b45402bb", "name": "network-vif-plugged", "status": "completed", "tag": "743286c8-2c3d-444d-ae91-8875dcf1827d"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:25.288279 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6b497635-a96c-47ab-a0eb-e9d0776ca91e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:25.289023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6b497635-a96c-47ab-a0eb-e9d0776ca91e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:25.300023 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b497635-a96c-47ab-a0eb-e9d0776ca91e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:25.300978 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b497635-a96c-47ab-a0eb-e9d0776ca91e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:25.301614 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b497635-a96c-47ab-a0eb-e9d0776ca91e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:25.302910 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b497635-a96c-47ab-a0eb-e9d0776ca91e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:25.303757 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-21299425-ecd5-4f22-8f91-c9165239cf65 req-c17b9695-75c5-4cf5-baaf-71359023dd6f service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:25.304197 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b497635-a96c-47ab-a0eb-e9d0776ca91e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:25.305002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6b497635-a96c-47ab-a0eb-e9d0776ca91e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:25.305562 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-21299425-ecd5-4f22-8f91-c9165239cf65 req-c17b9695-75c5-4cf5-baaf-71359023dd6f service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:25.306266 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-21299425-ecd5-4f22-8f91-c9165239cf65 req-c17b9695-75c5-4cf5-baaf-71359023dd6f service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:25.322976 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-21299425-ecd5-4f22-8f91-c9165239cf65 req-c17b9695-75c5-4cf5-baaf-71359023dd6f service nova] Creating event network-vif-plugged:743286c8-2c3d-444d-ae91-8875dcf1827d for instance 3ebd3320-a313-4dca-ba4b-d104b45402bb on hv-cinder-73116 Aug 24 16:53:25.331999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-21299425-ecd5-4f22-8f91-c9165239cf65 req-c17b9695-75c5-4cf5-baaf-71359023dd6f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048701 Aug 24 16:53:25.333041 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 504/1012] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:25.401408 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-6b497635-a96c-47ab-a0eb-e9d0776ca91e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:25.409959 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6b497635-a96c-47ab-a0eb-e9d0776ca91e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1274 microversion: 2.1 time: 0.127792 Aug 24 16:53:25.411385 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 509/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:25 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:25.906586 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-20647c9f-44f3-4bec-af21-8cf8c465c970 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:25.907317 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-20647c9f-44f3-4bec-af21-8cf8c465c970 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:25.915567 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20647c9f-44f3-4bec-af21-8cf8c465c970 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:25.916415 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20647c9f-44f3-4bec-af21-8cf8c465c970 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:25.917488 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20647c9f-44f3-4bec-af21-8cf8c465c970 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:25.918891 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20647c9f-44f3-4bec-af21-8cf8c465c970 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:25.920063 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20647c9f-44f3-4bec-af21-8cf8c465c970 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:25.921044 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20647c9f-44f3-4bec-af21-8cf8c465c970 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:26.279186 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-20647c9f-44f3-4bec-af21-8cf8c465c970 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:26.289353 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-20647c9f-44f3-4bec-af21-8cf8c465c970 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1267 microversion: 2.1 time: 0.388131 Aug 24 16:53:26.289917 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 505/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:25 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1267 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:26.438014 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c073dd01-7ab9-4caf-a64a-352648929eb6 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:26.439042 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c073dd01-7ab9-4caf-a64a-352648929eb6 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:26.446670 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c073dd01-7ab9-4caf-a64a-352648929eb6 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:26.447162 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c073dd01-7ab9-4caf-a64a-352648929eb6 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:26.447597 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c073dd01-7ab9-4caf-a64a-352648929eb6 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:26.448300 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c073dd01-7ab9-4caf-a64a-352648929eb6 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:26.448786 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c073dd01-7ab9-4caf-a64a-352648929eb6 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:26.449204 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c073dd01-7ab9-4caf-a64a-352648929eb6 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:26.741602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c073dd01-7ab9-4caf-a64a-352648929eb6 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:26.750670 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c073dd01-7ab9-4caf-a64a-352648929eb6 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1314 microversion: 2.1 time: 0.318841 Aug 24 16:53:26.751691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 510/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:26 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:27.322766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d8130483-e8d4-4562-9913-ccd904a2231f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:27.324275 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d8130483-e8d4-4562-9913-ccd904a2231f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:27.329994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d8130483-e8d4-4562-9913-ccd904a2231f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:27.330695 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d8130483-e8d4-4562-9913-ccd904a2231f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:27.331533 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d8130483-e8d4-4562-9913-ccd904a2231f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:27.332268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d8130483-e8d4-4562-9913-ccd904a2231f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:27.332751 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d8130483-e8d4-4562-9913-ccd904a2231f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:27.333379 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d8130483-e8d4-4562-9913-ccd904a2231f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:27.574486 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d8130483-e8d4-4562-9913-ccd904a2231f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:27.582497 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d8130483-e8d4-4562-9913-ccd904a2231f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1267 microversion: 2.1 time: 0.264366 Aug 24 16:53:27.584399 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 506/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:27 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:53:27.675008 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-8ac6ee0c-f3c4-4664-8d8a-3b9f9fc87b04 req-7b1e4eec-dc19-4048-b27a-15e8050d6d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab04ff84-1ea6-4938-8078-7faa60d94814", "tag": "956cc14c-61ce-4e36-9297-c34200bcb830"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:27.687876 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-8ac6ee0c-f3c4-4664-8d8a-3b9f9fc87b04 req-7b1e4eec-dc19-4048-b27a-15e8050d6d46 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:27.688493 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-8ac6ee0c-f3c4-4664-8d8a-3b9f9fc87b04 req-7b1e4eec-dc19-4048-b27a-15e8050d6d46 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:27.689017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-8ac6ee0c-f3c4-4664-8d8a-3b9f9fc87b04 req-7b1e4eec-dc19-4048-b27a-15e8050d6d46 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:27.708499 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-8ac6ee0c-f3c4-4664-8d8a-3b9f9fc87b04 req-7b1e4eec-dc19-4048-b27a-15e8050d6d46 service nova] Creating event network-changed:956cc14c-61ce-4e36-9297-c34200bcb830 for instance ab04ff84-1ea6-4938-8078-7faa60d94814 on hv-cinder-73116 Aug 24 16:53:27.714910 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-8ac6ee0c-f3c4-4664-8d8a-3b9f9fc87b04 req-7b1e4eec-dc19-4048-b27a-15e8050d6d46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047347 Aug 24 16:53:27.716441 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 511/1017] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:27.790737 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5fd27c3c-a191-43d5-88aa-62b35a1ee1ee tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:27.791355 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5fd27c3c-a191-43d5-88aa-62b35a1ee1ee tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:27.800405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5fd27c3c-a191-43d5-88aa-62b35a1ee1ee tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:27.801202 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5fd27c3c-a191-43d5-88aa-62b35a1ee1ee tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:27.801652 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5fd27c3c-a191-43d5-88aa-62b35a1ee1ee tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:27.802398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5fd27c3c-a191-43d5-88aa-62b35a1ee1ee tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:27.802871 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5fd27c3c-a191-43d5-88aa-62b35a1ee1ee tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:27.804010 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5fd27c3c-a191-43d5-88aa-62b35a1ee1ee tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:28.071696 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5fd27c3c-a191-43d5-88aa-62b35a1ee1ee tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:28.080370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5fd27c3c-a191-43d5-88aa-62b35a1ee1ee tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1314 microversion: 2.1 time: 0.297919 Aug 24 16:53:28.081002 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 507/1018] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:27 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:28.604051 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9dd1840d-e929-4260-b5ac-840aa90e69c5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:28.605002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9dd1840d-e929-4260-b5ac-840aa90e69c5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:28.611386 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9dd1840d-e929-4260-b5ac-840aa90e69c5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:28.611896 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9dd1840d-e929-4260-b5ac-840aa90e69c5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:28.612373 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9dd1840d-e929-4260-b5ac-840aa90e69c5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:28.613074 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9dd1840d-e929-4260-b5ac-840aa90e69c5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:28.613534 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9dd1840d-e929-4260-b5ac-840aa90e69c5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:28.613956 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9dd1840d-e929-4260-b5ac-840aa90e69c5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:28.762278 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9dd1840d-e929-4260-b5ac-840aa90e69c5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:28.770577 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9dd1840d-e929-4260-b5ac-840aa90e69c5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1455 microversion: 2.1 time: 0.171153 Aug 24 16:53:28.771150 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 512/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:28 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1455 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:28.792457 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e56ff5d0-e6d1-43b0-a101-db1bceb28b59 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:28.793062 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e56ff5d0-e6d1-43b0-a101-db1bceb28b59 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:28.800475 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e56ff5d0-e6d1-43b0-a101-db1bceb28b59 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:28.802192 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e56ff5d0-e6d1-43b0-a101-db1bceb28b59 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:28.802192 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e56ff5d0-e6d1-43b0-a101-db1bceb28b59 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:28.802192 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e56ff5d0-e6d1-43b0-a101-db1bceb28b59 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:28.802540 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e56ff5d0-e6d1-43b0-a101-db1bceb28b59 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:28.803488 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e56ff5d0-e6d1-43b0-a101-db1bceb28b59 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:28.968310 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e56ff5d0-e6d1-43b0-a101-db1bceb28b59 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:28.971546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e56ff5d0-e6d1-43b0-a101-db1bceb28b59 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1455 microversion: 2.1 time: 0.182922 Aug 24 16:53:28.972138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 508/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:28 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1455 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:29.104404 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-06d4d11f-80a1-4fda-baca-71e4a3336b26 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:29.109691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-06d4d11f-80a1-4fda-baca-71e4a3336b26 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:29.111846 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06d4d11f-80a1-4fda-baca-71e4a3336b26 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:29.112375 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06d4d11f-80a1-4fda-baca-71e4a3336b26 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:29.112807 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06d4d11f-80a1-4fda-baca-71e4a3336b26 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:29.113520 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06d4d11f-80a1-4fda-baca-71e4a3336b26 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:29.113974 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06d4d11f-80a1-4fda-baca-71e4a3336b26 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:29.114497 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-06d4d11f-80a1-4fda-baca-71e4a3336b26 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:29.353344 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-06d4d11f-80a1-4fda-baca-71e4a3336b26 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:29.361751 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-06d4d11f-80a1-4fda-baca-71e4a3336b26 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1314 microversion: 2.1 time: 0.262642 Aug 24 16:53:29.362341 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 513/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:29 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:30.392410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6c3e56b5-152f-458b-bc8d-f6c8f5617abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:30.393184 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6c3e56b5-152f-458b-bc8d-f6c8f5617abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:30.404382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c3e56b5-152f-458b-bc8d-f6c8f5617abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:30.406651 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c3e56b5-152f-458b-bc8d-f6c8f5617abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:30.407564 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c3e56b5-152f-458b-bc8d-f6c8f5617abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:30.409462 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c3e56b5-152f-458b-bc8d-f6c8f5617abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:30.410161 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c3e56b5-152f-458b-bc8d-f6c8f5617abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:30.411242 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c3e56b5-152f-458b-bc8d-f6c8f5617abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:30.592005 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6c3e56b5-152f-458b-bc8d-f6c8f5617abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:30.600384 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6c3e56b5-152f-458b-bc8d-f6c8f5617abf tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1314 microversion: 2.1 time: 0.211863 Aug 24 16:53:30.601016 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 509/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:30 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:31.621520 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-27bccc7c-a982-4b39-9882-16defbe0d81c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:31.622798 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-27bccc7c-a982-4b39-9882-16defbe0d81c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:31.629813 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27bccc7c-a982-4b39-9882-16defbe0d81c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:31.630279 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27bccc7c-a982-4b39-9882-16defbe0d81c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:31.630713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27bccc7c-a982-4b39-9882-16defbe0d81c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:31.631484 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27bccc7c-a982-4b39-9882-16defbe0d81c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:31.631936 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27bccc7c-a982-4b39-9882-16defbe0d81c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:31.632374 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-27bccc7c-a982-4b39-9882-16defbe0d81c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:31.786885 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-27bccc7c-a982-4b39-9882-16defbe0d81c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:31.796917 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-27bccc7c-a982-4b39-9882-16defbe0d81c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1314 microversion: 2.1 time: 0.179404 Aug 24 16:53:31.797654 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 514/1023] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:31 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:32.737674 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-a0aeac02-a47d-48d0-bde1-28a32b52d123 req-eab50e67-3396-4627-b9f3-5f1dec8080bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebd3320-a313-4dca-ba4b-d104b45402bb", "tag": "743286c8-2c3d-444d-ae91-8875dcf1827d"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:32.753857 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:32.755373 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=6 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:32.759844 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-a0aeac02-a47d-48d0-bde1-28a32b52d123 req-eab50e67-3396-4627-b9f3-5f1dec8080bd service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:32.760149 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-a0aeac02-a47d-48d0-bde1-28a32b52d123 req-eab50e67-3396-4627-b9f3-5f1dec8080bd service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:32.760975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-a0aeac02-a47d-48d0-bde1-28a32b52d123 req-eab50e67-3396-4627-b9f3-5f1dec8080bd service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:32.805919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-a0aeac02-a47d-48d0-bde1-28a32b52d123 req-eab50e67-3396-4627-b9f3-5f1dec8080bd service nova] Creating event network-changed:743286c8-2c3d-444d-ae91-8875dcf1827d for instance 3ebd3320-a313-4dca-ba4b-d104b45402bb on hv-cinder-73116 Aug 24 16:53:32.818805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-168bce3f-12a6-4163-9d84-66911a61d59f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:32.819550 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-168bce3f-12a6-4163-9d84-66911a61d59f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:32.825203 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-a0aeac02-a47d-48d0-bde1-28a32b52d123 req-eab50e67-3396-4627-b9f3-5f1dec8080bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093003 Aug 24 16:53:32.829381 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 510/1024] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:32.835039 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-168bce3f-12a6-4163-9d84-66911a61d59f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:32.835535 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-168bce3f-12a6-4163-9d84-66911a61d59f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:32.835971 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-168bce3f-12a6-4163-9d84-66911a61d59f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:32.836722 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-168bce3f-12a6-4163-9d84-66911a61d59f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:32.837196 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-168bce3f-12a6-4163-9d84-66911a61d59f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:32.837606 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-168bce3f-12a6-4163-9d84-66911a61d59f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:33.062851 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-168bce3f-12a6-4163-9d84-66911a61d59f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:33.089426 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-168bce3f-12a6-4163-9d84-66911a61d59f tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1314 microversion: 2.1 time: 0.274332 Aug 24 16:53:33.093358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 515/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:32 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:33.409682 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-89350500-bf75-49d1-bc27-345aac650aed req-f7d2151f-37ef-4f0a-968d-8989dc6cc018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab04ff84-1ea6-4938-8078-7faa60d94814", "name": "network-vif-plugged", "status": "completed", "tag": "956cc14c-61ce-4e36-9297-c34200bcb830"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:33.421044 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-89350500-bf75-49d1-bc27-345aac650aed req-f7d2151f-37ef-4f0a-968d-8989dc6cc018 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:33.421525 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-89350500-bf75-49d1-bc27-345aac650aed req-f7d2151f-37ef-4f0a-968d-8989dc6cc018 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:33.421990 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-89350500-bf75-49d1-bc27-345aac650aed req-f7d2151f-37ef-4f0a-968d-8989dc6cc018 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:33.438913 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-89350500-bf75-49d1-bc27-345aac650aed req-f7d2151f-37ef-4f0a-968d-8989dc6cc018 service nova] Creating event network-vif-plugged:956cc14c-61ce-4e36-9297-c34200bcb830 for instance ab04ff84-1ea6-4938-8078-7faa60d94814 on hv-cinder-73116 Aug 24 16:53:33.444114 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-89350500-bf75-49d1-bc27-345aac650aed req-f7d2151f-37ef-4f0a-968d-8989dc6cc018 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038236 Aug 24 16:53:33.444866 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 511/1026] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:34.116549 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c7c799d0-a5ca-4762-8386-88e0e92b3771 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:34.117171 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c7c799d0-a5ca-4762-8386-88e0e92b3771 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:34.119467 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=4 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:34.128893 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7c799d0-a5ca-4762-8386-88e0e92b3771 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:34.129389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7c799d0-a5ca-4762-8386-88e0e92b3771 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:34.129816 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7c799d0-a5ca-4762-8386-88e0e92b3771 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:34.130723 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7c799d0-a5ca-4762-8386-88e0e92b3771 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:34.131817 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7c799d0-a5ca-4762-8386-88e0e92b3771 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:34.132245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c7c799d0-a5ca-4762-8386-88e0e92b3771 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:34.362057 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c7c799d0-a5ca-4762-8386-88e0e92b3771 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:34.373163 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c7c799d0-a5ca-4762-8386-88e0e92b3771 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1314 microversion: 2.1 time: 0.261322 Aug 24 16:53:34.373804 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 516/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:34 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:35.396691 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-094255f0-77e3-4bde-9386-2971dd55d1c9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:35.397568 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-094255f0-77e3-4bde-9386-2971dd55d1c9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:35.405514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-094255f0-77e3-4bde-9386-2971dd55d1c9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:35.417050 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-094255f0-77e3-4bde-9386-2971dd55d1c9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:35.417050 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-094255f0-77e3-4bde-9386-2971dd55d1c9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:35.417050 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-094255f0-77e3-4bde-9386-2971dd55d1c9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:35.417050 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-094255f0-77e3-4bde-9386-2971dd55d1c9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:35.417978 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-094255f0-77e3-4bde-9386-2971dd55d1c9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:35.417978 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:35.581060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-094255f0-77e3-4bde-9386-2971dd55d1c9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:35.590446 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-094255f0-77e3-4bde-9386-2971dd55d1c9 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1314 microversion: 2.1 time: 0.198934 Aug 24 16:53:35.591591 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 512/1028] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:35 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:36.614940 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-61feac0a-a5b3-4c64-9146-cb59ab433a48 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:36.616324 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-61feac0a-a5b3-4c64-9146-cb59ab433a48 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:36.622958 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61feac0a-a5b3-4c64-9146-cb59ab433a48 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:36.623443 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61feac0a-a5b3-4c64-9146-cb59ab433a48 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:36.623872 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61feac0a-a5b3-4c64-9146-cb59ab433a48 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:36.624602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61feac0a-a5b3-4c64-9146-cb59ab433a48 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:36.625054 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61feac0a-a5b3-4c64-9146-cb59ab433a48 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:36.625487 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-61feac0a-a5b3-4c64-9146-cb59ab433a48 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:36.655687 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:36.829074 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-61feac0a-a5b3-4c64-9146-cb59ab433a48 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:36.847460 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-61feac0a-a5b3-4c64-9146-cb59ab433a48 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1497 microversion: 2.1 time: 0.236370 Aug 24 16:53:36.848406 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 517/1029] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:36 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1497 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:37.947713 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6908d1f4-ee57-4e30-8fc4-b23ecc24cf3e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:37.948376 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6908d1f4-ee57-4e30-8fc4-b23ecc24cf3e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:37.955588 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6908d1f4-ee57-4e30-8fc4-b23ecc24cf3e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:37.956079 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6908d1f4-ee57-4e30-8fc4-b23ecc24cf3e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:37.956645 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6908d1f4-ee57-4e30-8fc4-b23ecc24cf3e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:37.957287 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6908d1f4-ee57-4e30-8fc4-b23ecc24cf3e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:37.957748 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6908d1f4-ee57-4e30-8fc4-b23ecc24cf3e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:37.958174 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6908d1f4-ee57-4e30-8fc4-b23ecc24cf3e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:37.986411 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6908d1f4-ee57-4e30-8fc4-b23ecc24cf3e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:53:38.530901 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6908d1f4-ee57-4e30-8fc4-b23ecc24cf3e tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 204 len: 0 microversion: 2.1 time: 0.586803 Aug 24 16:53:38.531799 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 513/1030] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:53:37 2022] DELETE /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:53:38.541994 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f816f4d2-9b99-4cc8-a778-a25c6129394c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:38.542814 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f816f4d2-9b99-4cc8-a778-a25c6129394c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:38.550629 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f816f4d2-9b99-4cc8-a778-a25c6129394c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:38.551146 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f816f4d2-9b99-4cc8-a778-a25c6129394c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:38.551573 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f816f4d2-9b99-4cc8-a778-a25c6129394c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:38.552289 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f816f4d2-9b99-4cc8-a778-a25c6129394c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:38.552778 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f816f4d2-9b99-4cc8-a778-a25c6129394c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:38.553755 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f816f4d2-9b99-4cc8-a778-a25c6129394c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:38.715521 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f816f4d2-9b99-4cc8-a778-a25c6129394c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:38.724120 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f816f4d2-9b99-4cc8-a778-a25c6129394c tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1503 microversion: 2.1 time: 0.187267 Aug 24 16:53:38.724693 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 518/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:38 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:39.750076 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9f9294da-dbb2-41fd-9a4b-fb7811361822 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:39.750777 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9f9294da-dbb2-41fd-9a4b-fb7811361822 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:39.757575 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f9294da-dbb2-41fd-9a4b-fb7811361822 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:39.758068 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f9294da-dbb2-41fd-9a4b-fb7811361822 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:39.758497 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f9294da-dbb2-41fd-9a4b-fb7811361822 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:39.759202 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f9294da-dbb2-41fd-9a4b-fb7811361822 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:39.759645 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f9294da-dbb2-41fd-9a4b-fb7811361822 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:39.760064 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f9294da-dbb2-41fd-9a4b-fb7811361822 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:39.915420 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9f9294da-dbb2-41fd-9a4b-fb7811361822 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:39.923957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9f9294da-dbb2-41fd-9a4b-fb7811361822 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1503 microversion: 2.1 time: 0.179194 Aug 24 16:53:39.924933 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 514/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:39 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:53:40.845166 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-52a3afa4-3a81-4f22-ad9a-b55026794d5c req-7965438a-ada6-4139-a849-f00fcebd2338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab04ff84-1ea6-4938-8078-7faa60d94814", "name": "network-vif-deleted", "tag": "956cc14c-61ce-4e36-9297-c34200bcb830"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:40.858242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-52a3afa4-3a81-4f22-ad9a-b55026794d5c req-7965438a-ada6-4139-a849-f00fcebd2338 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:40.858728 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-52a3afa4-3a81-4f22-ad9a-b55026794d5c req-7965438a-ada6-4139-a849-f00fcebd2338 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:40.860659 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-52a3afa4-3a81-4f22-ad9a-b55026794d5c req-7965438a-ada6-4139-a849-f00fcebd2338 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:40.875253 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-52a3afa4-3a81-4f22-ad9a-b55026794d5c req-7965438a-ada6-4139-a849-f00fcebd2338 service nova] Creating event network-vif-deleted:956cc14c-61ce-4e36-9297-c34200bcb830 for instance ab04ff84-1ea6-4938-8078-7faa60d94814 on hv-cinder-73116 Aug 24 16:53:40.887776 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-52a3afa4-3a81-4f22-ad9a-b55026794d5c req-7965438a-ada6-4139-a849-f00fcebd2338 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040073 Aug 24 16:53:40.887776 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 519/1033] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:40.948450 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-36b4fc6f-0bb0-4b6d-ae42-d2c60dfe0762 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:40.949052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-36b4fc6f-0bb0-4b6d-ae42-d2c60dfe0762 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:40.956412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36b4fc6f-0bb0-4b6d-ae42-d2c60dfe0762 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:40.958842 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36b4fc6f-0bb0-4b6d-ae42-d2c60dfe0762 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:40.958842 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36b4fc6f-0bb0-4b6d-ae42-d2c60dfe0762 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:40.958842 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36b4fc6f-0bb0-4b6d-ae42-d2c60dfe0762 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:40.958842 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36b4fc6f-0bb0-4b6d-ae42-d2c60dfe0762 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:40.959487 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36b4fc6f-0bb0-4b6d-ae42-d2c60dfe0762 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:41.028267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-36b4fc6f-0bb0-4b6d-ae42-d2c60dfe0762 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:41.036509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-36b4fc6f-0bb0-4b6d-ae42-d2c60dfe0762 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1461 microversion: 2.1 time: 0.092727 Aug 24 16:53:41.037020 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 515/1034] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:40 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1461 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:42.062318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:42.063458 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:42.071195 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:42.071679 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:42.072107 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:42.072847 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:42.073301 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:42.073718 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:42.114932 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:42.115469 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:42.116116 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:42.116972 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.objects.instance [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lazy-loading 'fault' on Instance uuid ab04ff84-1ea6-4938-8078-7faa60d94814 {{(pid=127626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:53:42.192676 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651140ed5a704cde978be56393e0537e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee69068eb94cf1b4a0d78f7d5e4a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:42.203652 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-67d02dc2-eb8b-4b12-8c39-20f8e66ecec3 tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 200 len: 1304 microversion: 2.1 time: 0.146524 Aug 24 16:53:42.204246 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 520/1035] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:42 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:53:43.231243 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:43.231873 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] [instance: ab04ff84-1ea6-4938-8078-7faa60d94814] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:43.238938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:43.239443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:43.240121 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:43.241534 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:43.242040 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:43.242603 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:43.258219 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] HTTP exception thrown: Instance ab04ff84-1ea6-4938-8078-7faa60d94814 could not be found. Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Request method failure captured: Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 HTTP/1.1 Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBldh5P7HawhZTdyjMbdK1QKf-RFYusdt0rBWGcCUoUFaLrITD75t5b6UjKABtrJm6niVC9MCqd-n86UxmdjSba3gh9F1_09A0Uy-_0FxSN8UTl8ApxqsXGJBIRPU1Xmqf-G3hu_qN9hiAlxI_5m2er-UHsWZCizIj9yo25nkf20RPoQ Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 19ee69068eb94cf1b4a0d78f7d5e4a8b Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesActionsTest-289528995 Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:53:43.259899 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/19ee69068eb94cf1b4a0d78f7d5e4a8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/19ee69068eb94cf1b4a0d78f7d5e4a8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_19ee69068eb94cf1b4a0d78f7d5e4a8b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/19ee69068eb94cf1b4a0d78f7d5e4a8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesActionsTest-289528995 Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 19ee69068eb94cf1b4a0d78f7d5e4a8b Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesActionsTest-289528995 Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesActionsTest-289528995-project Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 651140ed5a704cde978be56393e0537e Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesActionsTest-289528995-project Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance ab04ff84-1ea6-4938-8078-7faa60d94814 could not be found. Aug 24 16:53:43.261370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': 'ab04ff84-1ea6-4938-8078-7faa60d94814'} Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab04ff84-1ea6-4938-8078-7faa60d94814 could not be found. Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:53:43.262285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab04ff84-1ea6-4938-8078-7faa60d94814 could not be found. Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab04ff84-1ea6-4938-8078-7faa60d94814 could not be found. Aug 24 16:53:43.263684 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:53:43.265084 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] Returning 404 to user: Instance ab04ff84-1ea6-4938-8078-7faa60d94814 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:53:43.265084 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c3d42be2-7d8c-4518-a6c9-333dfabe13ac tempest-VolumesActionsTest-289528995 tempest-VolumesActionsTest-289528995-project] 10.222.0.17 "GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814" status: 404 len: 111 microversion: 2.1 time: 0.038199 Aug 24 16:53:43.265084 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 516/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:43 2022] GET /compute/v2.1/servers/ab04ff84-1ea6-4938-8078-7faa60d94814 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:54:03.888792 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:54:03.889551 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Wed Aug 24 16:54:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:54:43.056895 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:43.057635 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=18 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:43.061639 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-985574974", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "networks": [{"uuid": "0fad45f7-64ff-4f27-a6f9-be1f6000309c"}]}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:43.317778 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.network.neutron [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] validate_networks() for [('0fad45f7-64ff-4f27-a6f9-be1f6000309c', None, None, None, None, None)] {{(pid=127626) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:54:43.731236 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Flavor limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:54:43.731769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Image limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:54:43.732476 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Flavor pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:54:43.732935 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Image pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:54:43.733496 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:54:43.742850 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:43.743313 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:43.743781 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:43.744529 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:43.744976 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:43.745393 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:43.765048 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Getting quotas for project 0c6157140b76496d8d6d05bfff3a9121. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:54:43.769419 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Getting quotas for user 5854a29681034733b989bf8c8bc59842 and project 0c6157140b76496d8d6d05bfff3a9121. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:54:43.781415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Going to run 1 instances... {{(pid=127626) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:54:43.783843 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:54:43.993294 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-eb437c3d-25d0-4556-98b8-682e79d80966 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938061 Aug 24 16:54:43.993948 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 521/1037] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 16:54:44.006377 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-756ae05d-7493-4a19-9a3f-044e8560381c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:44.007204 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-756ae05d-7493-4a19-9a3f-044e8560381c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:44.009363 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:44.010013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:44.198986 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-756ae05d-7493-4a19-9a3f-044e8560381c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:44.206356 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-756ae05d-7493-4a19-9a3f-044e8560381c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1218 microversion: 2.1 time: 0.205533 Aug 24 16:54:44.207033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 517/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:43 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:45.227648 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-59bbf692-b8c4-493d-82ba-c3ae1bd1c98b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:45.228616 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-59bbf692-b8c4-493d-82ba-c3ae1bd1c98b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:45.282138 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-59bbf692-b8c4-493d-82ba-c3ae1bd1c98b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:45.289522 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-59bbf692-b8c4-493d-82ba-c3ae1bd1c98b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1218 microversion: 2.1 time: 0.066342 Aug 24 16:54:45.290133 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 522/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:45 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:46.312315 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1f6a9315-0ca3-4add-a1a3-31c3cfa19965 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:46.312971 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1f6a9315-0ca3-4add-a1a3-31c3cfa19965 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:46.321504 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f6a9315-0ca3-4add-a1a3-31c3cfa19965 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:46.321995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f6a9315-0ca3-4add-a1a3-31c3cfa19965 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:46.322433 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f6a9315-0ca3-4add-a1a3-31c3cfa19965 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:46.323204 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f6a9315-0ca3-4add-a1a3-31c3cfa19965 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:46.323661 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f6a9315-0ca3-4add-a1a3-31c3cfa19965 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:46.324086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f6a9315-0ca3-4add-a1a3-31c3cfa19965 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:46.390729 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1f6a9315-0ca3-4add-a1a3-31c3cfa19965 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:46.399388 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1f6a9315-0ca3-4add-a1a3-31c3cfa19965 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1222 microversion: 2.1 time: 0.092615 Aug 24 16:54:46.399949 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 518/1040] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:46 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:47.420832 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-82e77823-0527-4381-a2f2-3b12144681c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:47.421451 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-82e77823-0527-4381-a2f2-3b12144681c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:47.429827 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-82e77823-0527-4381-a2f2-3b12144681c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:47.430314 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-82e77823-0527-4381-a2f2-3b12144681c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:47.430746 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-82e77823-0527-4381-a2f2-3b12144681c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:47.431487 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-82e77823-0527-4381-a2f2-3b12144681c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:47.431934 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-82e77823-0527-4381-a2f2-3b12144681c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:47.432379 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-82e77823-0527-4381-a2f2-3b12144681c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:47.497461 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-82e77823-0527-4381-a2f2-3b12144681c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:47.505898 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-82e77823-0527-4381-a2f2-3b12144681c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1222 microversion: 2.1 time: 0.088959 Aug 24 16:54:47.506475 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 523/1041] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:47 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:48.527200 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3c32486e-a821-4fc2-a606-3b03708c2a38 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:48.527965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3c32486e-a821-4fc2-a606-3b03708c2a38 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:48.534771 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c32486e-a821-4fc2-a606-3b03708c2a38 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:48.535287 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c32486e-a821-4fc2-a606-3b03708c2a38 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:48.535723 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c32486e-a821-4fc2-a606-3b03708c2a38 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:48.536476 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c32486e-a821-4fc2-a606-3b03708c2a38 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:48.536930 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c32486e-a821-4fc2-a606-3b03708c2a38 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:48.542433 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3c32486e-a821-4fc2-a606-3b03708c2a38 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:48.605380 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3c32486e-a821-4fc2-a606-3b03708c2a38 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:48.613093 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3c32486e-a821-4fc2-a606-3b03708c2a38 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1270 microversion: 2.1 time: 0.090423 Aug 24 16:54:48.613922 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 519/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:48 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:49.637242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c339edeb-ddd3-4526-97b9-a1349f0b9852 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:49.643860 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c339edeb-ddd3-4526-97b9-a1349f0b9852 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:49.645020 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c339edeb-ddd3-4526-97b9-a1349f0b9852 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:49.646167 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c339edeb-ddd3-4526-97b9-a1349f0b9852 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:49.646673 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c339edeb-ddd3-4526-97b9-a1349f0b9852 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:49.647481 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c339edeb-ddd3-4526-97b9-a1349f0b9852 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:49.648004 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c339edeb-ddd3-4526-97b9-a1349f0b9852 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:49.648786 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c339edeb-ddd3-4526-97b9-a1349f0b9852 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:49.808933 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c339edeb-ddd3-4526-97b9-a1349f0b9852 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:49.816808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c339edeb-ddd3-4526-97b9-a1349f0b9852 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1318 microversion: 2.1 time: 0.183520 Aug 24 16:54:49.817907 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 524/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:49 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:50.711054 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-5bee047b-c460-4370-bdb0-f5aeeb469719 req-dd391916-7ebf-4d89-b0e4-608a28056e19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f155eb-dfef-4b29-9b50-dee03a1efba6", "tag": "f92ff26b-1fd6-4762-b61d-f46fed31ae5e"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:50.719813 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5bee047b-c460-4370-bdb0-f5aeeb469719 req-dd391916-7ebf-4d89-b0e4-608a28056e19 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:50.720279 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5bee047b-c460-4370-bdb0-f5aeeb469719 req-dd391916-7ebf-4d89-b0e4-608a28056e19 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:50.720909 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5bee047b-c460-4370-bdb0-f5aeeb469719 req-dd391916-7ebf-4d89-b0e4-608a28056e19 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:50.734882 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-5bee047b-c460-4370-bdb0-f5aeeb469719 req-dd391916-7ebf-4d89-b0e4-608a28056e19 service nova] Creating event network-changed:f92ff26b-1fd6-4762-b61d-f46fed31ae5e for instance e7f155eb-dfef-4b29-9b50-dee03a1efba6 on hv-cinder-73116 Aug 24 16:54:50.742599 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-5bee047b-c460-4370-bdb0-f5aeeb469719 req-dd391916-7ebf-4d89-b0e4-608a28056e19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102336 Aug 24 16:54:50.743246 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 520/1044] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:50.839210 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3354d793-7fed-4708-93bf-d56b825f3c31 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:50.840569 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3354d793-7fed-4708-93bf-d56b825f3c31 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:50.847280 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3354d793-7fed-4708-93bf-d56b825f3c31 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:50.847774 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3354d793-7fed-4708-93bf-d56b825f3c31 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:50.848358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3354d793-7fed-4708-93bf-d56b825f3c31 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:50.849708 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3354d793-7fed-4708-93bf-d56b825f3c31 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:50.850153 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3354d793-7fed-4708-93bf-d56b825f3c31 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:50.850728 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3354d793-7fed-4708-93bf-d56b825f3c31 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:51.074030 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3354d793-7fed-4708-93bf-d56b825f3c31 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:51.085175 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3354d793-7fed-4708-93bf-d56b825f3c31 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1318 microversion: 2.1 time: 0.249658 Aug 24 16:54:51.085571 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 525/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:50 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:52.109459 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a0e669e5-f3e6-4a70-a1dc-495754c0efad tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:52.111381 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a0e669e5-f3e6-4a70-a1dc-495754c0efad tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:52.128138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e669e5-f3e6-4a70-a1dc-495754c0efad tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:52.128138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e669e5-f3e6-4a70-a1dc-495754c0efad tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:52.128138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e669e5-f3e6-4a70-a1dc-495754c0efad tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:52.130443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e669e5-f3e6-4a70-a1dc-495754c0efad tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:52.131563 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e669e5-f3e6-4a70-a1dc-495754c0efad tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:52.132140 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a0e669e5-f3e6-4a70-a1dc-495754c0efad tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:52.371440 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a0e669e5-f3e6-4a70-a1dc-495754c0efad tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:52.380024 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a0e669e5-f3e6-4a70-a1dc-495754c0efad tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1318 microversion: 2.1 time: 0.274764 Aug 24 16:54:52.384443 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 521/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:52 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:53.402267 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e52b0680-096d-46ab-b46a-3aff65dd2aa8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:53.402916 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e52b0680-096d-46ab-b46a-3aff65dd2aa8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:53.409411 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e52b0680-096d-46ab-b46a-3aff65dd2aa8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:53.409906 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e52b0680-096d-46ab-b46a-3aff65dd2aa8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:53.410373 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e52b0680-096d-46ab-b46a-3aff65dd2aa8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:53.411898 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e52b0680-096d-46ab-b46a-3aff65dd2aa8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:53.412527 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e52b0680-096d-46ab-b46a-3aff65dd2aa8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:53.412967 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e52b0680-096d-46ab-b46a-3aff65dd2aa8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:53.557199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e52b0680-096d-46ab-b46a-3aff65dd2aa8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:53.567307 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e52b0680-096d-46ab-b46a-3aff65dd2aa8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1318 microversion: 2.1 time: 0.168837 Aug 24 16:54:53.568266 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 526/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:53 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:54.598546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-10302673-549a-4e1c-b442-647f7faee2ae tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:54.599492 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-10302673-549a-4e1c-b442-647f7faee2ae tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:54.602850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:54.609011 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10302673-549a-4e1c-b442-647f7faee2ae tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:54.609011 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10302673-549a-4e1c-b442-647f7faee2ae tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:54.609011 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10302673-549a-4e1c-b442-647f7faee2ae tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:54.609354 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10302673-549a-4e1c-b442-647f7faee2ae tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:54.609801 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10302673-549a-4e1c-b442-647f7faee2ae tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:54.610213 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10302673-549a-4e1c-b442-647f7faee2ae tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:54.752117 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-10302673-549a-4e1c-b442-647f7faee2ae tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:54.761117 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-10302673-549a-4e1c-b442-647f7faee2ae tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1318 microversion: 2.1 time: 0.166489 Aug 24 16:54:54.761696 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 522/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:54 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:55.761423 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-3bf29229-3e29-49e3-8466-fc8d9d255db6 req-1286af1f-04a4-4bb0-b24c-a6414d2fb88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f155eb-dfef-4b29-9b50-dee03a1efba6", "name": "network-vif-plugged", "status": "completed", "tag": "f92ff26b-1fd6-4762-b61d-f46fed31ae5e"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:55.773697 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:55.773697 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=8 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:55.773697 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-3bf29229-3e29-49e3-8466-fc8d9d255db6 req-1286af1f-04a4-4bb0-b24c-a6414d2fb88e service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:55.774063 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-3bf29229-3e29-49e3-8466-fc8d9d255db6 req-1286af1f-04a4-4bb0-b24c-a6414d2fb88e service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:55.774204 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-3bf29229-3e29-49e3-8466-fc8d9d255db6 req-1286af1f-04a4-4bb0-b24c-a6414d2fb88e service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:55.783187 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1d8da4e7-f62f-4901-b355-c0f549ef2421 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:55.783801 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1d8da4e7-f62f-4901-b355-c0f549ef2421 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:55.785292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-3bf29229-3e29-49e3-8466-fc8d9d255db6 req-1286af1f-04a4-4bb0-b24c-a6414d2fb88e service nova] Creating event network-vif-plugged:f92ff26b-1fd6-4762-b61d-f46fed31ae5e for instance e7f155eb-dfef-4b29-9b50-dee03a1efba6 on hv-cinder-73116 Aug 24 16:54:55.790802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-3bf29229-3e29-49e3-8466-fc8d9d255db6 req-1286af1f-04a4-4bb0-b24c-a6414d2fb88e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033418 Aug 24 16:54:55.791401 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 527/1049] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:55.792251 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d8da4e7-f62f-4901-b355-c0f549ef2421 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:55.792777 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d8da4e7-f62f-4901-b355-c0f549ef2421 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:55.793278 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d8da4e7-f62f-4901-b355-c0f549ef2421 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:55.794087 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d8da4e7-f62f-4901-b355-c0f549ef2421 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:55.794502 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d8da4e7-f62f-4901-b355-c0f549ef2421 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:55.794833 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d8da4e7-f62f-4901-b355-c0f549ef2421 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:56.211693 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1d8da4e7-f62f-4901-b355-c0f549ef2421 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:56.219600 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1d8da4e7-f62f-4901-b355-c0f549ef2421 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1318 microversion: 2.1 time: 0.440372 Aug 24 16:54:56.220541 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 523/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:55 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:54:57.241521 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-399f3d52-685c-4366-bedf-6656ca010f84 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:57.242125 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-399f3d52-685c-4366-bedf-6656ca010f84 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:57.249378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-399f3d52-685c-4366-bedf-6656ca010f84 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:57.249861 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-399f3d52-685c-4366-bedf-6656ca010f84 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:57.250289 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-399f3d52-685c-4366-bedf-6656ca010f84 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:57.250971 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-399f3d52-685c-4366-bedf-6656ca010f84 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:57.251417 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-399f3d52-685c-4366-bedf-6656ca010f84 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:57.251835 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-399f3d52-685c-4366-bedf-6656ca010f84 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:57.389467 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-399f3d52-685c-4366-bedf-6656ca010f84 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:57.398335 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-399f3d52-685c-4366-bedf-6656ca010f84 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1318 microversion: 2.1 time: 0.161825 Aug 24 16:54:57.398914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 528/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:57 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:58.419377 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-50e2c569-8943-4823-a090-6151ab27eb30 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:58.420027 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-50e2c569-8943-4823-a090-6151ab27eb30 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:58.427483 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50e2c569-8943-4823-a090-6151ab27eb30 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:58.427959 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50e2c569-8943-4823-a090-6151ab27eb30 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:58.428410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50e2c569-8943-4823-a090-6151ab27eb30 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:58.429100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50e2c569-8943-4823-a090-6151ab27eb30 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:58.429555 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50e2c569-8943-4823-a090-6151ab27eb30 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:58.429967 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50e2c569-8943-4823-a090-6151ab27eb30 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:58.575060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-50e2c569-8943-4823-a090-6151ab27eb30 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:58.582790 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-50e2c569-8943-4823-a090-6151ab27eb30 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1506 microversion: 2.1 time: 0.167386 Aug 24 16:54:58.583368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 524/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:58 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:14.323908 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-4f2c365c-bf34-4707-9bdb-fbbfd5b58e92 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaa01a18-7125-4fc3-aecc-c75e1b44900b", "device": "/dev/sdb"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:14.327189 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-4f2c365c-bf34-4707-9bdb-fbbfd5b58e92 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:14.329471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:14.334307 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=34 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:14.335118 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4f2c365c-bf34-4707-9bdb-fbbfd5b58e92 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:14.336151 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4f2c365c-bf34-4707-9bdb-fbbfd5b58e92 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:14.336626 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4f2c365c-bf34-4707-9bdb-fbbfd5b58e92 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:14.337333 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4f2c365c-bf34-4707-9bdb-fbbfd5b58e92 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:14.337787 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4f2c365c-bf34-4707-9bdb-fbbfd5b58e92 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:14.338212 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-4f2c365c-bf34-4707-9bdb-fbbfd5b58e92 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:15.133321 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-4f2c365c-bf34-4707-9bdb-fbbfd5b58e92 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "POST /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.815152 Aug 24 16:55:15.133943 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 529/1053] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:55:14 2022] POST /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6/os-volume_attachments => generated 194 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:31.189066 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4901400a-4c25-49ff-a669-d56cd322754f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:31.189642 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4901400a-4c25-49ff-a669-d56cd322754f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:31.191663 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=18 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:31.192311 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=38 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:31.197320 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4901400a-4c25-49ff-a669-d56cd322754f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:31.197876 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4901400a-4c25-49ff-a669-d56cd322754f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:31.200410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4901400a-4c25-49ff-a669-d56cd322754f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:31.200410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4901400a-4c25-49ff-a669-d56cd322754f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:31.200410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4901400a-4c25-49ff-a669-d56cd322754f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:31.200410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4901400a-4c25-49ff-a669-d56cd322754f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:31.230835 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4901400a-4c25-49ff-a669-d56cd322754f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:55:31.539411 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4901400a-4c25-49ff-a669-d56cd322754f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 204 len: 0 microversion: 2.1 time: 0.354362 Aug 24 16:55:31.540016 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 525/1054] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:55:31 2022] DELETE /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:31.546087 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:31.559045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:31.559045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-d159770e-ac38-49e8-b978-83f84aae16a1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:31.559045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-d159770e-ac38-49e8-b978-83f84aae16a1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:31.559045 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d159770e-ac38-49e8-b978-83f84aae16a1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:31.559713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d159770e-ac38-49e8-b978-83f84aae16a1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:31.559713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d159770e-ac38-49e8-b978-83f84aae16a1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:31.560415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d159770e-ac38-49e8-b978-83f84aae16a1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:31.560872 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d159770e-ac38-49e8-b978-83f84aae16a1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:31.561291 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-d159770e-ac38-49e8-b978-83f84aae16a1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:31.720880 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-d159770e-ac38-49e8-b978-83f84aae16a1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:31.729811 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-d159770e-ac38-49e8-b978-83f84aae16a1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1580 microversion: 2.1 time: 0.185204 Aug 24 16:55:31.730393 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 530/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:31 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1580 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:32.755371 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1d19d28e-ac24-43a0-9023-e1a839fb7231 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:32.756678 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1d19d28e-ac24-43a0-9023-e1a839fb7231 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:32.763344 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d19d28e-ac24-43a0-9023-e1a839fb7231 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:32.763829 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d19d28e-ac24-43a0-9023-e1a839fb7231 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:32.764261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d19d28e-ac24-43a0-9023-e1a839fb7231 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:32.764985 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d19d28e-ac24-43a0-9023-e1a839fb7231 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:32.765436 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d19d28e-ac24-43a0-9023-e1a839fb7231 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:32.765857 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d19d28e-ac24-43a0-9023-e1a839fb7231 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:32.932064 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1d19d28e-ac24-43a0-9023-e1a839fb7231 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:32.942596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1d19d28e-ac24-43a0-9023-e1a839fb7231 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1580 microversion: 2.1 time: 0.193939 Aug 24 16:55:32.943268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 526/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:32 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1580 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:33.967145 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b77e8215-9d17-4849-90e1-9fae2b892005 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:33.968110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b77e8215-9d17-4849-90e1-9fae2b892005 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:33.976588 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b77e8215-9d17-4849-90e1-9fae2b892005 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:33.977465 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b77e8215-9d17-4849-90e1-9fae2b892005 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:33.978194 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b77e8215-9d17-4849-90e1-9fae2b892005 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:33.979426 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b77e8215-9d17-4849-90e1-9fae2b892005 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:33.980207 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b77e8215-9d17-4849-90e1-9fae2b892005 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:33.980970 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b77e8215-9d17-4849-90e1-9fae2b892005 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:34.130903 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b77e8215-9d17-4849-90e1-9fae2b892005 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:34.139398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b77e8215-9d17-4849-90e1-9fae2b892005 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1580 microversion: 2.1 time: 0.176708 Aug 24 16:55:34.139954 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 531/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:33 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1580 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:35.160531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-74a3200d-9f51-4f65-91bd-4e80571988c3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:35.161100 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-74a3200d-9f51-4f65-91bd-4e80571988c3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:35.168156 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74a3200d-9f51-4f65-91bd-4e80571988c3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:35.168676 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74a3200d-9f51-4f65-91bd-4e80571988c3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:35.169118 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74a3200d-9f51-4f65-91bd-4e80571988c3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:35.169850 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74a3200d-9f51-4f65-91bd-4e80571988c3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:35.170310 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74a3200d-9f51-4f65-91bd-4e80571988c3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:35.170737 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-74a3200d-9f51-4f65-91bd-4e80571988c3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:35.316948 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-74a3200d-9f51-4f65-91bd-4e80571988c3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:35.326673 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-74a3200d-9f51-4f65-91bd-4e80571988c3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1580 microversion: 2.1 time: 0.170095 Aug 24 16:55:35.327268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 527/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:35 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1580 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:36.351506 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-51e1642b-92c1-430b-9b14-02d37734f73f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:36.352156 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-51e1642b-92c1-430b-9b14-02d37734f73f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:36.360025 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e1642b-92c1-430b-9b14-02d37734f73f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:36.360564 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e1642b-92c1-430b-9b14-02d37734f73f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:36.361028 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e1642b-92c1-430b-9b14-02d37734f73f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:36.361691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e1642b-92c1-430b-9b14-02d37734f73f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:36.362147 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e1642b-92c1-430b-9b14-02d37734f73f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:36.362602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51e1642b-92c1-430b-9b14-02d37734f73f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:36.664698 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-51e1642b-92c1-430b-9b14-02d37734f73f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:36.673849 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-51e1642b-92c1-430b-9b14-02d37734f73f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1580 microversion: 2.1 time: 0.328164 Aug 24 16:55:36.674745 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 532/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:36 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1580 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:37.182199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-66694711-26ae-480e-9300-014b6e1e5e9a req-f59ed5f4-94df-4318-9f84-aa577940d262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebd3320-a313-4dca-ba4b-d104b45402bb", "name": "network-vif-deleted", "tag": "743286c8-2c3d-444d-ae91-8875dcf1827d"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:37.208735 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-66694711-26ae-480e-9300-014b6e1e5e9a req-f59ed5f4-94df-4318-9f84-aa577940d262 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:37.211389 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-66694711-26ae-480e-9300-014b6e1e5e9a req-f59ed5f4-94df-4318-9f84-aa577940d262 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:37.212600 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-66694711-26ae-480e-9300-014b6e1e5e9a req-f59ed5f4-94df-4318-9f84-aa577940d262 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:37.237957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-66694711-26ae-480e-9300-014b6e1e5e9a req-f59ed5f4-94df-4318-9f84-aa577940d262 service nova] Creating event network-vif-deleted:743286c8-2c3d-444d-ae91-8875dcf1827d for instance 3ebd3320-a313-4dca-ba4b-d104b45402bb on hv-cinder-73116 Aug 24 16:55:37.246057 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-66694711-26ae-480e-9300-014b6e1e5e9a req-f59ed5f4-94df-4318-9f84-aa577940d262 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070463 Aug 24 16:55:37.251889 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 528/1060] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:37.699230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2c4ca3f8-cd99-4ecf-8d02-cda2c753ffdb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:37.700381 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2c4ca3f8-cd99-4ecf-8d02-cda2c753ffdb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:37.708808 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c4ca3f8-cd99-4ecf-8d02-cda2c753ffdb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:37.709468 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c4ca3f8-cd99-4ecf-8d02-cda2c753ffdb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:37.710126 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c4ca3f8-cd99-4ecf-8d02-cda2c753ffdb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:37.710913 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c4ca3f8-cd99-4ecf-8d02-cda2c753ffdb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:37.711617 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c4ca3f8-cd99-4ecf-8d02-cda2c753ffdb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:37.712202 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2c4ca3f8-cd99-4ecf-8d02-cda2c753ffdb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:37.800164 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2c4ca3f8-cd99-4ecf-8d02-cda2c753ffdb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:37.815044 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2c4ca3f8-cd99-4ecf-8d02-cda2c753ffdb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 200 len: 1226 microversion: 2.1 time: 0.122745 Aug 24 16:55:37.816389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 533/1061] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:37 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:38.840853 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:38.841661 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:38.848299 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:38.848595 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:38.849023 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:38.849831 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:38.850557 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:38.850742 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:38.866398 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] HTTP exception thrown: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Request method failure captured: Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb HTTP/1.1 Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBldGURwsduxzzbx4Sxdp_K2tpAxY_NRMWHaABTphjFKxKPjyNaal1TeiD-UxQVtxJumve1piB6NLEg0g3vQ8LL-4r8nhB_IX7tsaCUgQYnFmjmWk2bRnZMbhjCpW8sK-x5CGyOiPVWhvPOtA56MUSkdtEBzlYeL--lyJWC9ECMBcRnY Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: f18db8d724d4436cb1721859066ac74d Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-TestVolumeBootPattern-659221413 Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:55:38.868085 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f18db8d724d4436cb1721859066ac74d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-TestVolumeBootPattern-659221413 Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: f18db8d724d4436cb1721859066ac74d Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-TestVolumeBootPattern-659221413 Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-TestVolumeBootPattern-659221413-project Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: aaa4ddbee1034946a1f4dfe751a2b5cd Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-TestVolumeBootPattern-659221413-project Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:55:38.869772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '3ebd3320-a313-4dca-ba4b-d104b45402bb'} Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:38.877914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:55:38.879405 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:55:38.881347 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Returning 404 to user: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:38.881347 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a6a981e9-0f94-48e1-8c54-51585002017b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 404 len: 111 microversion: 2.1 time: 0.033448 Aug 24 16:55:38.881347 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 529/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:38 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:38.983389 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1700027841", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1100356887", "security_groups": [{"name": "tempest-secgroup-smoke-1875641850"}], "block_device_mapping_v2": [{"uuid": "62bcd9e7-384d-4cf3-8d95-6ebd3527b4a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a598ee64-8390-470b-8704-7686a7a90fa6"}]}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:39.115287 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.network.neutron [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] validate_networks() for [('a598ee64-8390-470b-8704-7686a7a90fa6', None, None, None, None, None)] {{(pid=127626) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:55:39.582188 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Flavor limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:55:39.582627 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Image limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:55:39.583137 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Flavor pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:55:39.583588 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Image pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:55:39.584024 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:55:39.600364 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:39.600710 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:39.601170 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:39.601975 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:39.602433 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:39.602872 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:39.621601 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Getting quotas for project f18db8d724d4436cb1721859066ac74d. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:55:39.626115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Getting quotas for user aaa4ddbee1034946a1f4dfe751a2b5cd and project f18db8d724d4436cb1721859066ac74d. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:55:39.694140 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Going to run 1 instances... {{(pid=127626) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:55:39.696381 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62bcd9e7-384d-4cf3-8d95-6ebd3527b4a6',volume_size=None,volume_type=None)] {{(pid=127626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:55:40.060267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-507eee2d-4b45-4e58-838d-4b879791a6b1 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:40.060874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-507eee2d-4b45-4e58-838d-4b879791a6b1 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:40.067764 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507eee2d-4b45-4e58-838d-4b879791a6b1 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:40.068327 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507eee2d-4b45-4e58-838d-4b879791a6b1 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:40.068881 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507eee2d-4b45-4e58-838d-4b879791a6b1 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:40.069579 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507eee2d-4b45-4e58-838d-4b879791a6b1 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:40.070040 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507eee2d-4b45-4e58-838d-4b879791a6b1 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:40.070513 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-507eee2d-4b45-4e58-838d-4b879791a6b1 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:40.109898 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e95cf1dc-440b-4112-83b8-4de9a77215fb tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.130451 Aug 24 16:55:40.110578 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 534/1063] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:55:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 16:55:40.121980 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-95451a54-3699-4221-ada3-3c275c4d39e4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:40.122587 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-95451a54-3699-4221-ada3-3c275c4d39e4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:40.187713 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-507eee2d-4b45-4e58-838d-4b879791a6b1 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lazy-loading 'services' on Instance uuid e7f155eb-dfef-4b29-9b50-dee03a1efba6 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:55:40.196791 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-95451a54-3699-4221-ada3-3c275c4d39e4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:40.209726 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-95451a54-3699-4221-ada3-3c275c4d39e4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1095 microversion: 2.1 time: 0.091010 Aug 24 16:55:40.210393 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 535/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:40 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:40.524710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-507eee2d-4b45-4e58-838d-4b879791a6b1 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6/os-volume_attachments/aaa01a18-7125-4fc3-aecc-c75e1b44900b" status: 202 len: 0 microversion: 2.1 time: 0.467602 Aug 24 16:55:40.525300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 530/1065] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:55:40 2022] DELETE /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6/os-volume_attachments/aaa01a18-7125-4fc3-aecc-c75e1b44900b => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 16:55:41.231503 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-3e284ef3-9566-4857-be1d-2edeb6ac6aa3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:41.232126 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-3e284ef3-9566-4857-be1d-2edeb6ac6aa3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:41.238985 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e284ef3-9566-4857-be1d-2edeb6ac6aa3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:41.239473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e284ef3-9566-4857-be1d-2edeb6ac6aa3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:41.240228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e284ef3-9566-4857-be1d-2edeb6ac6aa3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:41.241148 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e284ef3-9566-4857-be1d-2edeb6ac6aa3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:41.241551 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e284ef3-9566-4857-be1d-2edeb6ac6aa3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:41.241994 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-3e284ef3-9566-4857-be1d-2edeb6ac6aa3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:41.320545 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-3e284ef3-9566-4857-be1d-2edeb6ac6aa3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:41.335800 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-3e284ef3-9566-4857-be1d-2edeb6ac6aa3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1145 microversion: 2.1 time: 0.107756 Aug 24 16:55:41.336989 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 536/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:41 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1145 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:41.674308 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-67390d64-4d34-4f8c-be85-0d14ed991962 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:41.674913 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-67390d64-4d34-4f8c-be85-0d14ed991962 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:41.683581 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67390d64-4d34-4f8c-be85-0d14ed991962 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:41.684086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67390d64-4d34-4f8c-be85-0d14ed991962 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:41.684563 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67390d64-4d34-4f8c-be85-0d14ed991962 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:41.685299 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67390d64-4d34-4f8c-be85-0d14ed991962 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:41.685822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67390d64-4d34-4f8c-be85-0d14ed991962 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:41.686254 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67390d64-4d34-4f8c-be85-0d14ed991962 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:41.714359 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-67390d64-4d34-4f8c-be85-0d14ed991962 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:55:42.095678 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-67390d64-4d34-4f8c-be85-0d14ed991962 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 204 len: 0 microversion: 2.1 time: 0.426330 Aug 24 16:55:42.096270 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 531/1067] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:55:41 2022] DELETE /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:42.105116 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f42b664b-28a0-461d-a98d-ae2783fc487b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:42.106547 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f42b664b-28a0-461d-a98d-ae2783fc487b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:42.113991 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f42b664b-28a0-461d-a98d-ae2783fc487b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:42.114476 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f42b664b-28a0-461d-a98d-ae2783fc487b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:42.114905 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f42b664b-28a0-461d-a98d-ae2783fc487b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:42.116934 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f42b664b-28a0-461d-a98d-ae2783fc487b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:42.117415 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f42b664b-28a0-461d-a98d-ae2783fc487b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:42.118128 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f42b664b-28a0-461d-a98d-ae2783fc487b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:42.277438 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f42b664b-28a0-461d-a98d-ae2783fc487b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:42.286238 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f42b664b-28a0-461d-a98d-ae2783fc487b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1512 microversion: 2.1 time: 0.184908 Aug 24 16:55:42.286812 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 537/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:42 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:42.362958 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7c25f195-2696-426e-92cb-e1aef4c0c8f5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:42.363558 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7c25f195-2696-426e-92cb-e1aef4c0c8f5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:42.370353 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c25f195-2696-426e-92cb-e1aef4c0c8f5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:42.370838 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c25f195-2696-426e-92cb-e1aef4c0c8f5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:42.371267 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c25f195-2696-426e-92cb-e1aef4c0c8f5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:42.371954 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c25f195-2696-426e-92cb-e1aef4c0c8f5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:42.372428 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c25f195-2696-426e-92cb-e1aef4c0c8f5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:42.372847 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c25f195-2696-426e-92cb-e1aef4c0c8f5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:42.442221 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7c25f195-2696-426e-92cb-e1aef4c0c8f5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:42.450924 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7c25f195-2696-426e-92cb-e1aef4c0c8f5 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1201 microversion: 2.1 time: 0.092213 Aug 24 16:55:42.451519 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 532/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:42 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:43.310769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-6e24c58a-53d7-4753-a64c-a99cc152b1a0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:43.311489 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-6e24c58a-53d7-4753-a64c-a99cc152b1a0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:43.317944 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e24c58a-53d7-4753-a64c-a99cc152b1a0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:43.318471 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e24c58a-53d7-4753-a64c-a99cc152b1a0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:43.318904 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e24c58a-53d7-4753-a64c-a99cc152b1a0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:43.319717 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e24c58a-53d7-4753-a64c-a99cc152b1a0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:43.320163 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e24c58a-53d7-4753-a64c-a99cc152b1a0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:43.320610 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-6e24c58a-53d7-4753-a64c-a99cc152b1a0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:43.472205 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-6e24c58a-53d7-4753-a64c-a99cc152b1a0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:43.473776 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6b7e33d6-5f4b-44a2-9c2d-1e1ccd9bb80a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:43.475338 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6b7e33d6-5f4b-44a2-9c2d-1e1ccd9bb80a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:43.482203 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b7e33d6-5f4b-44a2-9c2d-1e1ccd9bb80a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:43.494862 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-6e24c58a-53d7-4753-a64c-a99cc152b1a0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1512 microversion: 2.1 time: 0.175725 Aug 24 16:55:43.495050 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b7e33d6-5f4b-44a2-9c2d-1e1ccd9bb80a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:43.495166 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 538/1070] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:43 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:43.495271 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b7e33d6-5f4b-44a2-9c2d-1e1ccd9bb80a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:43.495271 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b7e33d6-5f4b-44a2-9c2d-1e1ccd9bb80a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:43.495271 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b7e33d6-5f4b-44a2-9c2d-1e1ccd9bb80a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:43.495271 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b7e33d6-5f4b-44a2-9c2d-1e1ccd9bb80a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:43.593514 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6b7e33d6-5f4b-44a2-9c2d-1e1ccd9bb80a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:43.601731 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6b7e33d6-5f4b-44a2-9c2d-1e1ccd9bb80a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1201 microversion: 2.1 time: 0.133038 Aug 24 16:55:43.602319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 533/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:43 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1201 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:44.512583 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b38e5e8b-5061-40e6-8f00-5294e0940dc0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:44.522274 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b38e5e8b-5061-40e6-8f00-5294e0940dc0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:44.537914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b38e5e8b-5061-40e6-8f00-5294e0940dc0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:44.538465 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b38e5e8b-5061-40e6-8f00-5294e0940dc0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:44.538897 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b38e5e8b-5061-40e6-8f00-5294e0940dc0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:44.539644 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b38e5e8b-5061-40e6-8f00-5294e0940dc0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:44.540097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b38e5e8b-5061-40e6-8f00-5294e0940dc0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:44.540566 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b38e5e8b-5061-40e6-8f00-5294e0940dc0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:44.622505 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cf1fe008-ffc4-409a-89c7-86d9911ba46a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:44.623138 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cf1fe008-ffc4-409a-89c7-86d9911ba46a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:44.630276 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf1fe008-ffc4-409a-89c7-86d9911ba46a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:44.630934 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf1fe008-ffc4-409a-89c7-86d9911ba46a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:44.631759 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf1fe008-ffc4-409a-89c7-86d9911ba46a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:44.632491 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf1fe008-ffc4-409a-89c7-86d9911ba46a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:44.633058 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf1fe008-ffc4-409a-89c7-86d9911ba46a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:44.633608 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf1fe008-ffc4-409a-89c7-86d9911ba46a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:44.798988 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cf1fe008-ffc4-409a-89c7-86d9911ba46a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:44.807938 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cf1fe008-ffc4-409a-89c7-86d9911ba46a tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1211 microversion: 2.1 time: 0.189481 Aug 24 16:55:44.808549 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 534/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:44 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1211 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:44.992890 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-cfb03e5e-e3b3-4b00-a14d-d62d12020345 req-c5deb0ba-9c70-4e14-8c3f-f8529caa8ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f155eb-dfef-4b29-9b50-dee03a1efba6", "name": "network-vif-deleted", "tag": "f92ff26b-1fd6-4762-b61d-f46fed31ae5e"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:44.994689 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b38e5e8b-5061-40e6-8f00-5294e0940dc0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:45.002300 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-cfb03e5e-e3b3-4b00-a14d-d62d12020345 req-c5deb0ba-9c70-4e14-8c3f-f8529caa8ed7 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:45.002780 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-cfb03e5e-e3b3-4b00-a14d-d62d12020345 req-c5deb0ba-9c70-4e14-8c3f-f8529caa8ed7 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:45.003205 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-cfb03e5e-e3b3-4b00-a14d-d62d12020345 req-c5deb0ba-9c70-4e14-8c3f-f8529caa8ed7 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:45.003794 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b38e5e8b-5061-40e6-8f00-5294e0940dc0 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 200 len: 1512 microversion: 2.1 time: 0.497760 Aug 24 16:55:45.004411 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 539/1073] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:44 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 1512 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:45.014857 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-cfb03e5e-e3b3-4b00-a14d-d62d12020345 req-c5deb0ba-9c70-4e14-8c3f-f8529caa8ed7 service nova] Creating event network-vif-deleted:f92ff26b-1fd6-4762-b61d-f46fed31ae5e for instance e7f155eb-dfef-4b29-9b50-dee03a1efba6 on hv-cinder-73116 Aug 24 16:55:45.019675 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-cfb03e5e-e3b3-4b00-a14d-d62d12020345 req-c5deb0ba-9c70-4e14-8c3f-f8529caa8ed7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031178 Aug 24 16:55:45.022273 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 535/1074] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:55:45.829641 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-9985cac8-bcb8-4cc7-a49e-a7e1d77dfcc0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:45.830253 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-9985cac8-bcb8-4cc7-a49e-a7e1d77dfcc0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:45.847199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9985cac8-bcb8-4cc7-a49e-a7e1d77dfcc0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:45.847695 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9985cac8-bcb8-4cc7-a49e-a7e1d77dfcc0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:45.848130 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9985cac8-bcb8-4cc7-a49e-a7e1d77dfcc0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:45.848986 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9985cac8-bcb8-4cc7-a49e-a7e1d77dfcc0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:45.849741 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9985cac8-bcb8-4cc7-a49e-a7e1d77dfcc0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:45.851203 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-9985cac8-bcb8-4cc7-a49e-a7e1d77dfcc0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:46.027560 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:46.028302 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: e7f155eb-dfef-4b29-9b50-dee03a1efba6] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:46.036481 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:46.037259 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:46.037844 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:46.038733 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:46.039692 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:46.040483 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:46.057188 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-9985cac8-bcb8-4cc7-a49e-a7e1d77dfcc0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:46.066669 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] HTTP exception thrown: Instance e7f155eb-dfef-4b29-9b50-dee03a1efba6 could not be found. Aug 24 16:55:46.067313 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-9985cac8-bcb8-4cc7-a49e-a7e1d77dfcc0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.241532 Aug 24 16:55:46.075804 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 540/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:45 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Request method failure captured: Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 HTTP/1.1 Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlfQPqCKFGdY77MMpN23rHeY0cU4bBEwmJ0YfvMdNAC9X2_oNoHylRGYIV6i8mNCufvaoZoit4bldCZqB7F-x_131ZUVunSag63Uamwl5zEyrqIMkkOzhDPaMuckn8tF-xsz6g8onOZ-AmuPYR_ZMahe8xPF9YAAwQy4MQI2OghbJVQ Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 0c6157140b76496d8d6d05bfff3a9121 Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesSnapshotTestJSON-345344012 Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:55:46.075965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0c6157140b76496d8d6d05bfff3a9121"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6157140b76496d8d6d05bfff3a9121"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0c6157140b76496d8d6d05bfff3a9121", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6157140b76496d8d6d05bfff3a9121"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesSnapshotTestJSON-345344012 Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 0c6157140b76496d8d6d05bfff3a9121 Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-345344012 Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesSnapshotTestJSON-345344012-project Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 5854a29681034733b989bf8c8bc59842 Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesSnapshotTestJSON-345344012-project Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance e7f155eb-dfef-4b29-9b50-dee03a1efba6 could not be found. Aug 24 16:55:46.077597 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': 'e7f155eb-dfef-4b29-9b50-dee03a1efba6'} Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7f155eb-dfef-4b29-9b50-dee03a1efba6 could not be found. Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:46.078559 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7f155eb-dfef-4b29-9b50-dee03a1efba6 could not be found. Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7f155eb-dfef-4b29-9b50-dee03a1efba6 could not be found. Aug 24 16:55:46.079919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:55:46.081288 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Returning 404 to user: Instance e7f155eb-dfef-4b29-9b50-dee03a1efba6 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:46.081288 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5a757bc8-c8d6-4ffc-8e1e-23cd7a36751c tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6" status: 404 len: 111 microversion: 2.1 time: 0.047945 Aug 24 16:55:46.081288 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 536/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:46 2022] GET /compute/v2.1/servers/e7f155eb-dfef-4b29-9b50-dee03a1efba6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:55:47.033666 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-4e337203-d2ac-45c2-951e-943b43d211c6 req-2d8e1b52-8081-4c91-bd8a-3ca5affb9bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93aa8a9-96b8-4360-bb4d-36fa81f3b459", "tag": "db15a5f4-0c41-433b-9c1f-94e2e5f90555"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:47.044108 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-4e337203-d2ac-45c2-951e-943b43d211c6 req-2d8e1b52-8081-4c91-bd8a-3ca5affb9bf3 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:47.044639 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-4e337203-d2ac-45c2-951e-943b43d211c6 req-2d8e1b52-8081-4c91-bd8a-3ca5affb9bf3 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:47.045057 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-4e337203-d2ac-45c2-951e-943b43d211c6 req-2d8e1b52-8081-4c91-bd8a-3ca5affb9bf3 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:47.056961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-4e337203-d2ac-45c2-951e-943b43d211c6 req-2d8e1b52-8081-4c91-bd8a-3ca5affb9bf3 service nova] Creating event network-changed:db15a5f4-0c41-433b-9c1f-94e2e5f90555 for instance d93aa8a9-96b8-4360-bb4d-36fa81f3b459 on hv-cinder-73116 Aug 24 16:55:47.061884 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-4e337203-d2ac-45c2-951e-943b43d211c6 req-2d8e1b52-8081-4c91-bd8a-3ca5affb9bf3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031923 Aug 24 16:55:47.062466 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 541/1077] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:47.089572 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-403d072a-1131-44b7-8aa4-cde32067ea7e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:47.090181 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-403d072a-1131-44b7-8aa4-cde32067ea7e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:47.096699 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-403d072a-1131-44b7-8aa4-cde32067ea7e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:47.097186 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-403d072a-1131-44b7-8aa4-cde32067ea7e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:47.097625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-403d072a-1131-44b7-8aa4-cde32067ea7e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:47.098313 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-403d072a-1131-44b7-8aa4-cde32067ea7e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:47.098767 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-403d072a-1131-44b7-8aa4-cde32067ea7e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:47.099192 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-403d072a-1131-44b7-8aa4-cde32067ea7e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:47.240585 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-403d072a-1131-44b7-8aa4-cde32067ea7e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:47.248689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-403d072a-1131-44b7-8aa4-cde32067ea7e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.162930 Aug 24 16:55:47.249261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 537/1078] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:47 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:48.271477 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-c29c1482-24c7-4976-a6bd-5002e34f4990 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:48.272187 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-c29c1482-24c7-4976-a6bd-5002e34f4990 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:48.278747 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c29c1482-24c7-4976-a6bd-5002e34f4990 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:48.279233 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c29c1482-24c7-4976-a6bd-5002e34f4990 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:48.279668 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c29c1482-24c7-4976-a6bd-5002e34f4990 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:48.280392 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c29c1482-24c7-4976-a6bd-5002e34f4990 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:48.280852 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c29c1482-24c7-4976-a6bd-5002e34f4990 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:48.281276 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-c29c1482-24c7-4976-a6bd-5002e34f4990 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:48.436731 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-c29c1482-24c7-4976-a6bd-5002e34f4990 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:48.444394 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-c29c1482-24c7-4976-a6bd-5002e34f4990 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.177760 Aug 24 16:55:48.444995 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 542/1079] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:48 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:49.465324 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5d51a70b-f988-4bbc-b16c-020a9b5575fe tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:49.465961 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5d51a70b-f988-4bbc-b16c-020a9b5575fe tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:49.472883 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d51a70b-f988-4bbc-b16c-020a9b5575fe tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:49.473370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d51a70b-f988-4bbc-b16c-020a9b5575fe tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:49.473800 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d51a70b-f988-4bbc-b16c-020a9b5575fe tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:49.474651 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d51a70b-f988-4bbc-b16c-020a9b5575fe tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:49.475110 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d51a70b-f988-4bbc-b16c-020a9b5575fe tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:49.476070 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5d51a70b-f988-4bbc-b16c-020a9b5575fe tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:49.718370 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5d51a70b-f988-4bbc-b16c-020a9b5575fe tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:49.727412 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5d51a70b-f988-4bbc-b16c-020a9b5575fe tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.265914 Aug 24 16:55:49.729610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 538/1080] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:49 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:50.749269 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-320c9f5e-5f0d-4145-9b0d-eef63dca1534 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:50.749880 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-320c9f5e-5f0d-4145-9b0d-eef63dca1534 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:50.752324 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:50.753068 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=8 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:50.757795 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-320c9f5e-5f0d-4145-9b0d-eef63dca1534 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:50.758285 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-320c9f5e-5f0d-4145-9b0d-eef63dca1534 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:50.758722 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-320c9f5e-5f0d-4145-9b0d-eef63dca1534 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:50.759421 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-320c9f5e-5f0d-4145-9b0d-eef63dca1534 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:50.759875 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-320c9f5e-5f0d-4145-9b0d-eef63dca1534 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:50.760297 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-320c9f5e-5f0d-4145-9b0d-eef63dca1534 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:50.904464 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-320c9f5e-5f0d-4145-9b0d-eef63dca1534 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:50.912434 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-320c9f5e-5f0d-4145-9b0d-eef63dca1534 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.166971 Aug 24 16:55:50.913019 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 543/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:50 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:51.934174 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-abc346c3-cd04-4acb-b8b1-0b495c2edf8d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:51.934784 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-abc346c3-cd04-4acb-b8b1-0b495c2edf8d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:51.941375 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abc346c3-cd04-4acb-b8b1-0b495c2edf8d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:51.941861 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abc346c3-cd04-4acb-b8b1-0b495c2edf8d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:51.942305 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abc346c3-cd04-4acb-b8b1-0b495c2edf8d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:51.943023 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abc346c3-cd04-4acb-b8b1-0b495c2edf8d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:51.943476 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abc346c3-cd04-4acb-b8b1-0b495c2edf8d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:51.944606 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abc346c3-cd04-4acb-b8b1-0b495c2edf8d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:52.076515 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-abc346c3-cd04-4acb-b8b1-0b495c2edf8d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:52.087488 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-abc346c3-cd04-4acb-b8b1-0b495c2edf8d tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.157116 Aug 24 16:55:52.088066 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 539/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:51 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:53.108098 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b821cc17-740d-4de5-8228-edaad68f2641 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:53.108756 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b821cc17-740d-4de5-8228-edaad68f2641 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:53.115552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b821cc17-740d-4de5-8228-edaad68f2641 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:53.116333 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b821cc17-740d-4de5-8228-edaad68f2641 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:53.116795 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b821cc17-740d-4de5-8228-edaad68f2641 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:53.117490 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b821cc17-740d-4de5-8228-edaad68f2641 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:53.118142 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b821cc17-740d-4de5-8228-edaad68f2641 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:53.118567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b821cc17-740d-4de5-8228-edaad68f2641 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:53.257041 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b821cc17-740d-4de5-8228-edaad68f2641 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:53.264658 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b821cc17-740d-4de5-8228-edaad68f2641 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.160389 Aug 24 16:55:53.265224 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 544/1083] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:53 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:54.286074 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-61ad15c1-c793-4817-8285-f8af056bab4f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:54.286688 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-61ad15c1-c793-4817-8285-f8af056bab4f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:54.293438 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61ad15c1-c793-4817-8285-f8af056bab4f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:54.293969 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61ad15c1-c793-4817-8285-f8af056bab4f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:54.294403 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61ad15c1-c793-4817-8285-f8af056bab4f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:54.295114 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61ad15c1-c793-4817-8285-f8af056bab4f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:54.295571 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61ad15c1-c793-4817-8285-f8af056bab4f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:54.296005 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61ad15c1-c793-4817-8285-f8af056bab4f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:54.300668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:54.448250 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-61ad15c1-c793-4817-8285-f8af056bab4f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:54.456395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-61ad15c1-c793-4817-8285-f8af056bab4f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.174119 Aug 24 16:55:54.456975 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 540/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:54 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:55.478538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-db02fcce-5e57-4473-b2cb-c45ca89e00e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:55.479092 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-db02fcce-5e57-4473-b2cb-c45ca89e00e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:55.485593 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db02fcce-5e57-4473-b2cb-c45ca89e00e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:55.486064 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db02fcce-5e57-4473-b2cb-c45ca89e00e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:55.486504 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db02fcce-5e57-4473-b2cb-c45ca89e00e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:55.487180 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db02fcce-5e57-4473-b2cb-c45ca89e00e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:55.487629 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db02fcce-5e57-4473-b2cb-c45ca89e00e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:55.488046 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-db02fcce-5e57-4473-b2cb-c45ca89e00e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:55.629543 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-db02fcce-5e57-4473-b2cb-c45ca89e00e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:55.638296 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-db02fcce-5e57-4473-b2cb-c45ca89e00e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.164306 Aug 24 16:55:55.639046 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 545/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:55 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:55.797409 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-608600741", "imageRef": "bb368d48-33ac-4381-bd4b-97ef4394fc57", "flavorRef": "452", "networks": [{"uuid": "0fad45f7-64ff-4f27-a6f9-be1f6000309c"}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:55.862669 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] validate_networks() for [('0fad45f7-64ff-4f27-a6f9-be1f6000309c', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:55:56.350892 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:55:56.351327 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:55:56.351810 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:55:56.352222 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:55:56.352663 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:55:56.361833 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:56.362319 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:56.362759 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:56.366285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:56.366285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:56.366285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:56.385687 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Getting quotas for project 0c6157140b76496d8d6d05bfff3a9121. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:55:56.389956 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Getting quotas for user 5854a29681034733b989bf8c8bc59842 and project 0c6157140b76496d8d6d05bfff3a9121. Resources: {'instances', 'cores', 'ram'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:55:56.402086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:55:56.404414 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb368d48-33ac-4381-bd4b-97ef4394fc57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:55:56.522139 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [c7d94810-c9ef-496a-bf6b-27584e4d2554] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 16:55:56.659570 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-fe8cb181-02a3-4218-a5f6-2a435284aa9f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:56.660245 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-fe8cb181-02a3-4218-a5f6-2a435284aa9f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:56.667619 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe8cb181-02a3-4218-a5f6-2a435284aa9f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:56.668116 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe8cb181-02a3-4218-a5f6-2a435284aa9f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:56.668575 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe8cb181-02a3-4218-a5f6-2a435284aa9f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:56.669275 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe8cb181-02a3-4218-a5f6-2a435284aa9f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:56.669723 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe8cb181-02a3-4218-a5f6-2a435284aa9f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:56.670190 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-fe8cb181-02a3-4218-a5f6-2a435284aa9f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:56.821217 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-fe8cb181-02a3-4218-a5f6-2a435284aa9f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:56.829986 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-fe8cb181-02a3-4218-a5f6-2a435284aa9f tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.174575 Aug 24 16:55:56.830572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 546/1086] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:56 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:57.532131 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [c7d94810-c9ef-496a-bf6b-27584e4d2554] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 50072. Aug 24 16:55:57.536863 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9e25f174-23f0-4f17-9a2d-884fe8c9544a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.743464 Aug 24 16:55:57.537521 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 541/1087] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 16:55:57.548556 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b26a8abc-2fd9-43e9-89f1-bd6e17b087e5 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:57.549171 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b26a8abc-2fd9-43e9-89f1-bd6e17b087e5 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:57.601822 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b26a8abc-2fd9-43e9-89f1-bd6e17b087e5 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:57.608555 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b26a8abc-2fd9-43e9-89f1-bd6e17b087e5 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1218 microversion: 2.1 time: 0.064096 Aug 24 16:55:57.609318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 547/1088] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:57 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:57.853364 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6c5865ec-02b9-4000-8e14-01fecff9b0a3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:57.854364 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6c5865ec-02b9-4000-8e14-01fecff9b0a3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:57.864549 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c5865ec-02b9-4000-8e14-01fecff9b0a3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:57.865044 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c5865ec-02b9-4000-8e14-01fecff9b0a3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:57.865477 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c5865ec-02b9-4000-8e14-01fecff9b0a3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:57.866207 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c5865ec-02b9-4000-8e14-01fecff9b0a3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:57.867167 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c5865ec-02b9-4000-8e14-01fecff9b0a3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:57.867620 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c5865ec-02b9-4000-8e14-01fecff9b0a3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:58.045646 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6c5865ec-02b9-4000-8e14-01fecff9b0a3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:58.056033 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6c5865ec-02b9-4000-8e14-01fecff9b0a3 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.208105 Aug 24 16:55:58.056532 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 542/1089] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:57 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:58.255165 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-af9d4346-13f0-4e68-83f2-6147c13b8f00 req-6df33732-fcf9-4b3a-92ca-3ffd64db0495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93aa8a9-96b8-4360-bb4d-36fa81f3b459", "name": "network-vif-plugged", "status": "completed", "tag": "db15a5f4-0c41-433b-9c1f-94e2e5f90555"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:58.255165 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-af9d4346-13f0-4e68-83f2-6147c13b8f00 req-6df33732-fcf9-4b3a-92ca-3ffd64db0495 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:58.255165 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-af9d4346-13f0-4e68-83f2-6147c13b8f00 req-6df33732-fcf9-4b3a-92ca-3ffd64db0495 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:58.255165 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-af9d4346-13f0-4e68-83f2-6147c13b8f00 req-6df33732-fcf9-4b3a-92ca-3ffd64db0495 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:58.257104 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-af9d4346-13f0-4e68-83f2-6147c13b8f00 req-6df33732-fcf9-4b3a-92ca-3ffd64db0495 service nova] Creating event network-vif-plugged:db15a5f4-0c41-433b-9c1f-94e2e5f90555 for instance d93aa8a9-96b8-4360-bb4d-36fa81f3b459 on hv-cinder-73116 Aug 24 16:55:58.257104 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-af9d4346-13f0-4e68-83f2-6147c13b8f00 req-6df33732-fcf9-4b3a-92ca-3ffd64db0495 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169866 Aug 24 16:55:58.257104 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 548/1090] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:58.628981 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-54e8be87-482a-4d8b-b916-bde6a210a021 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:58.629611 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-54e8be87-482a-4d8b-b916-bde6a210a021 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:58.636071 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e8be87-482a-4d8b-b916-bde6a210a021 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:58.636590 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e8be87-482a-4d8b-b916-bde6a210a021 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:58.637073 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e8be87-482a-4d8b-b916-bde6a210a021 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:58.637773 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e8be87-482a-4d8b-b916-bde6a210a021 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:58.638220 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e8be87-482a-4d8b-b916-bde6a210a021 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:58.638640 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54e8be87-482a-4d8b-b916-bde6a210a021 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:58.726765 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-54e8be87-482a-4d8b-b916-bde6a210a021 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:58.735967 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-54e8be87-482a-4d8b-b916-bde6a210a021 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1222 microversion: 2.1 time: 0.111583 Aug 24 16:55:58.736836 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 543/1091] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:58 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:59.077790 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-32a3b83b-057f-4f1d-927f-1ba0c351b48e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:59.078488 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-32a3b83b-057f-4f1d-927f-1ba0c351b48e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:59.084616 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32a3b83b-057f-4f1d-927f-1ba0c351b48e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:59.085100 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32a3b83b-057f-4f1d-927f-1ba0c351b48e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:59.086226 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32a3b83b-057f-4f1d-927f-1ba0c351b48e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:59.086931 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32a3b83b-057f-4f1d-927f-1ba0c351b48e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:59.087385 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32a3b83b-057f-4f1d-927f-1ba0c351b48e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:59.087811 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-32a3b83b-057f-4f1d-927f-1ba0c351b48e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:59.229127 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-32a3b83b-057f-4f1d-927f-1ba0c351b48e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:59.237368 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-32a3b83b-057f-4f1d-927f-1ba0c351b48e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1267 microversion: 2.1 time: 0.163746 Aug 24 16:55:59.237965 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 549/1092] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:59 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:59.758610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-07b70d16-30b0-410e-ba79-402c38d4060a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:59.759295 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-07b70d16-30b0-410e-ba79-402c38d4060a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:59.766009 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07b70d16-30b0-410e-ba79-402c38d4060a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:59.766506 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07b70d16-30b0-410e-ba79-402c38d4060a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:59.766945 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07b70d16-30b0-410e-ba79-402c38d4060a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:59.767761 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07b70d16-30b0-410e-ba79-402c38d4060a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:59.768312 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07b70d16-30b0-410e-ba79-402c38d4060a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:59.768774 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07b70d16-30b0-410e-ba79-402c38d4060a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:59.833325 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-07b70d16-30b0-410e-ba79-402c38d4060a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:59.842616 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-07b70d16-30b0-410e-ba79-402c38d4060a tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1270 microversion: 2.1 time: 0.089246 Aug 24 16:55:59.843223 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 544/1093] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:59 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:00.259211 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-a2f5279a-ad0b-4e99-a15d-8dc4eeb210b2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:00.259860 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-a2f5279a-ad0b-4e99-a15d-8dc4eeb210b2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:00.266455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2f5279a-ad0b-4e99-a15d-8dc4eeb210b2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:00.266947 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2f5279a-ad0b-4e99-a15d-8dc4eeb210b2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:00.267417 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2f5279a-ad0b-4e99-a15d-8dc4eeb210b2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:00.268120 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2f5279a-ad0b-4e99-a15d-8dc4eeb210b2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:00.268607 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2f5279a-ad0b-4e99-a15d-8dc4eeb210b2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:00.269032 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-a2f5279a-ad0b-4e99-a15d-8dc4eeb210b2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:00.290059 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=100 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:00.424677 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-a2f5279a-ad0b-4e99-a15d-8dc4eeb210b2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:00.433794 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-a2f5279a-ad0b-4e99-a15d-8dc4eeb210b2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1454 microversion: 2.1 time: 0.179153 Aug 24 16:56:00.434378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 550/1094] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:00 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1454 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:00.456612 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-324c3ea9-1ef5-454e-931c-d40a9a1fa75e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:00.457218 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-324c3ea9-1ef5-454e-931c-d40a9a1fa75e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:00.463220 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-324c3ea9-1ef5-454e-931c-d40a9a1fa75e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:00.463698 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-324c3ea9-1ef5-454e-931c-d40a9a1fa75e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:00.464125 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-324c3ea9-1ef5-454e-931c-d40a9a1fa75e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:00.464839 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-324c3ea9-1ef5-454e-931c-d40a9a1fa75e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:00.465289 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-324c3ea9-1ef5-454e-931c-d40a9a1fa75e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:00.465708 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-324c3ea9-1ef5-454e-931c-d40a9a1fa75e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:00.714749 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-324c3ea9-1ef5-454e-931c-d40a9a1fa75e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:00.719434 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-324c3ea9-1ef5-454e-931c-d40a9a1fa75e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1454 microversion: 2.1 time: 0.266245 Aug 24 16:56:00.719863 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 545/1095] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:00 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1454 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:00.865300 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-b815e7ce-7e9e-4713-ba7b-54c3b19daf7e tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:00.865890 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-b815e7ce-7e9e-4713-ba7b-54c3b19daf7e tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:00.872749 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b815e7ce-7e9e-4713-ba7b-54c3b19daf7e tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:00.873227 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b815e7ce-7e9e-4713-ba7b-54c3b19daf7e tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:00.873665 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b815e7ce-7e9e-4713-ba7b-54c3b19daf7e tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:00.874356 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b815e7ce-7e9e-4713-ba7b-54c3b19daf7e tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:00.874805 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b815e7ce-7e9e-4713-ba7b-54c3b19daf7e tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:00.875234 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-b815e7ce-7e9e-4713-ba7b-54c3b19daf7e tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:00.946639 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-b815e7ce-7e9e-4713-ba7b-54c3b19daf7e tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:00.958414 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-b815e7ce-7e9e-4713-ba7b-54c3b19daf7e tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1288 microversion: 2.1 time: 0.096601 Aug 24 16:56:00.959967 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 551/1096] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:00 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:56:01.984479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f54a6dd7-3cfe-47e0-8acb-87fbb6901b03 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:01.985095 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f54a6dd7-3cfe-47e0-8acb-87fbb6901b03 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:01.987508 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:01.992515 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f54a6dd7-3cfe-47e0-8acb-87fbb6901b03 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:01.993122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f54a6dd7-3cfe-47e0-8acb-87fbb6901b03 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:01.993363 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f54a6dd7-3cfe-47e0-8acb-87fbb6901b03 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:01.994073 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f54a6dd7-3cfe-47e0-8acb-87fbb6901b03 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:01.994528 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f54a6dd7-3cfe-47e0-8acb-87fbb6901b03 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:01.994952 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f54a6dd7-3cfe-47e0-8acb-87fbb6901b03 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:02.236074 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f54a6dd7-3cfe-47e0-8acb-87fbb6901b03 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:02.246334 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f54a6dd7-3cfe-47e0-8acb-87fbb6901b03 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1318 microversion: 2.1 time: 0.265724 Aug 24 16:56:02.246921 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 546/1097] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:01 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:02.531546 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-13693634-ae4e-4401-ac13-edf57816c42f req-58544195-71f2-4100-bbf6-15c21556e390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a693f69-508b-4433-8628-9d929eb2507d", "tag": "136ca553-7d2d-4c1a-aed6-8831c99be33d"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:56:02.537373 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:02.544398 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-13693634-ae4e-4401-ac13-edf57816c42f req-58544195-71f2-4100-bbf6-15c21556e390 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:02.545086 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-13693634-ae4e-4401-ac13-edf57816c42f req-58544195-71f2-4100-bbf6-15c21556e390 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:02.545647 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-13693634-ae4e-4401-ac13-edf57816c42f req-58544195-71f2-4100-bbf6-15c21556e390 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:02.559230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-13693634-ae4e-4401-ac13-edf57816c42f req-58544195-71f2-4100-bbf6-15c21556e390 service nova] Creating event network-changed:136ca553-7d2d-4c1a-aed6-8831c99be33d for instance 4a693f69-508b-4433-8628-9d929eb2507d on hv-cinder-73116 Aug 24 16:56:02.564629 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-13693634-ae4e-4401-ac13-edf57816c42f req-58544195-71f2-4100-bbf6-15c21556e390 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036800 Aug 24 16:56:02.565627 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 552/1098] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:56:03.114225 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-40d80ea7-81cb-4837-998d-50e440e536d7 req-08be1425-b469-449d-815a-c451526cb641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93aa8a9-96b8-4360-bb4d-36fa81f3b459", "tag": "db15a5f4-0c41-433b-9c1f-94e2e5f90555"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:56:03.124674 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-40d80ea7-81cb-4837-998d-50e440e536d7 req-08be1425-b469-449d-815a-c451526cb641 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:03.125172 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-40d80ea7-81cb-4837-998d-50e440e536d7 req-08be1425-b469-449d-815a-c451526cb641 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:03.125608 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-40d80ea7-81cb-4837-998d-50e440e536d7 req-08be1425-b469-449d-815a-c451526cb641 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:03.138061 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-40d80ea7-81cb-4837-998d-50e440e536d7 req-08be1425-b469-449d-815a-c451526cb641 service nova] Creating event network-changed:db15a5f4-0c41-433b-9c1f-94e2e5f90555 for instance d93aa8a9-96b8-4360-bb4d-36fa81f3b459 on hv-cinder-73116 Aug 24 16:56:03.143413 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-40d80ea7-81cb-4837-998d-50e440e536d7 req-08be1425-b469-449d-815a-c451526cb641 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115688 Aug 24 16:56:03.144633 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 547/1099] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:56:03.270321 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-46a01ce9-5e4a-4cc5-94ce-b2ecdcebfeb8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:03.271029 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-46a01ce9-5e4a-4cc5-94ce-b2ecdcebfeb8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:03.279271 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-46a01ce9-5e4a-4cc5-94ce-b2ecdcebfeb8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:03.279271 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-46a01ce9-5e4a-4cc5-94ce-b2ecdcebfeb8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:03.279271 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-46a01ce9-5e4a-4cc5-94ce-b2ecdcebfeb8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:03.281537 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-46a01ce9-5e4a-4cc5-94ce-b2ecdcebfeb8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:03.281537 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-46a01ce9-5e4a-4cc5-94ce-b2ecdcebfeb8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:03.281796 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-46a01ce9-5e4a-4cc5-94ce-b2ecdcebfeb8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:03.895518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-46a01ce9-5e4a-4cc5-94ce-b2ecdcebfeb8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:03.905710 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-46a01ce9-5e4a-4cc5-94ce-b2ecdcebfeb8 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1318 microversion: 2.1 time: 0.640341 Aug 24 16:56:03.907097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 553/1100] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:03 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:04.930282 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4f4903bb-2174-40d6-bac8-4a07b5fc8778 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:04.937479 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4f4903bb-2174-40d6-bac8-4a07b5fc8778 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:04.937956 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f4903bb-2174-40d6-bac8-4a07b5fc8778 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:04.938450 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f4903bb-2174-40d6-bac8-4a07b5fc8778 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:04.938876 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f4903bb-2174-40d6-bac8-4a07b5fc8778 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:04.939585 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f4903bb-2174-40d6-bac8-4a07b5fc8778 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:04.940035 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f4903bb-2174-40d6-bac8-4a07b5fc8778 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:04.940496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f4903bb-2174-40d6-bac8-4a07b5fc8778 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:05.089694 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4f4903bb-2174-40d6-bac8-4a07b5fc8778 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:05.097888 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4f4903bb-2174-40d6-bac8-4a07b5fc8778 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1318 microversion: 2.1 time: 0.173065 Aug 24 16:56:05.098484 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 548/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:04 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:56:06.120041 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2a9ed64a-1374-4d89-8712-e967f0f97642 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:06.120691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2a9ed64a-1374-4d89-8712-e967f0f97642 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:06.127536 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2a9ed64a-1374-4d89-8712-e967f0f97642 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:06.128038 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2a9ed64a-1374-4d89-8712-e967f0f97642 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:06.128499 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2a9ed64a-1374-4d89-8712-e967f0f97642 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:06.129212 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2a9ed64a-1374-4d89-8712-e967f0f97642 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:06.129673 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2a9ed64a-1374-4d89-8712-e967f0f97642 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:06.130109 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2a9ed64a-1374-4d89-8712-e967f0f97642 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:06.140634 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:56:06.146064 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Wed Aug 24 16:56:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d (ip 10.222.0.17) !!! Aug 24 16:56:06.282005 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2a9ed64a-1374-4d89-8712-e967f0f97642 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:06.290473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2a9ed64a-1374-4d89-8712-e967f0f97642 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1318 microversion: 2.1 time: 0.175035 Aug 24 16:56:06.291086 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 554/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:06 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:07.311257 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fcd07796-ff2f-4a82-a50d-7adec8e65034 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:07.311894 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fcd07796-ff2f-4a82-a50d-7adec8e65034 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:07.314596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:07.315318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=6 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:07.321051 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fcd07796-ff2f-4a82-a50d-7adec8e65034 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:07.321534 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fcd07796-ff2f-4a82-a50d-7adec8e65034 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:07.321970 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fcd07796-ff2f-4a82-a50d-7adec8e65034 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:07.322665 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fcd07796-ff2f-4a82-a50d-7adec8e65034 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:07.323115 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fcd07796-ff2f-4a82-a50d-7adec8e65034 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:07.323535 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fcd07796-ff2f-4a82-a50d-7adec8e65034 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:07.467054 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fcd07796-ff2f-4a82-a50d-7adec8e65034 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:07.474928 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fcd07796-ff2f-4a82-a50d-7adec8e65034 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1318 microversion: 2.1 time: 0.167660 Aug 24 16:56:07.475495 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 549/1103] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:07 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:08.112382 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-f45b1d20-b357-439a-9a6a-840a3bbba114 req-04f3c1d1-3903-4738-b120-792bd9ff7d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a693f69-508b-4433-8628-9d929eb2507d", "name": "network-vif-plugged", "status": "completed", "tag": "136ca553-7d2d-4c1a-aed6-8831c99be33d"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:56:08.118691 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:08.124248 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-f45b1d20-b357-439a-9a6a-840a3bbba114 req-04f3c1d1-3903-4738-b120-792bd9ff7d71 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:08.124780 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-f45b1d20-b357-439a-9a6a-840a3bbba114 req-04f3c1d1-3903-4738-b120-792bd9ff7d71 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:08.125249 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-f45b1d20-b357-439a-9a6a-840a3bbba114 req-04f3c1d1-3903-4738-b120-792bd9ff7d71 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:08.136292 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-f45b1d20-b357-439a-9a6a-840a3bbba114 req-04f3c1d1-3903-4738-b120-792bd9ff7d71 service nova] Creating event network-vif-plugged:136ca553-7d2d-4c1a-aed6-8831c99be33d for instance 4a693f69-508b-4433-8628-9d929eb2507d on hv-cinder-73116 Aug 24 16:56:08.141534 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-f45b1d20-b357-439a-9a6a-840a3bbba114 req-04f3c1d1-3903-4738-b120-792bd9ff7d71 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032839 Aug 24 16:56:08.142122 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 555/1104] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:56:08.496882 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d94c4504-506b-4f53-b591-d2cf5e2bda91 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:08.497494 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d94c4504-506b-4f53-b591-d2cf5e2bda91 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:08.507530 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d94c4504-506b-4f53-b591-d2cf5e2bda91 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:08.508025 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d94c4504-506b-4f53-b591-d2cf5e2bda91 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:08.508500 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d94c4504-506b-4f53-b591-d2cf5e2bda91 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:08.509212 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d94c4504-506b-4f53-b591-d2cf5e2bda91 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:08.509662 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d94c4504-506b-4f53-b591-d2cf5e2bda91 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:08.510086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d94c4504-506b-4f53-b591-d2cf5e2bda91 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:08.700637 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d94c4504-506b-4f53-b591-d2cf5e2bda91 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:08.708291 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d94c4504-506b-4f53-b591-d2cf5e2bda91 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1318 microversion: 2.1 time: 0.215282 Aug 24 16:56:08.708872 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 550/1105] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:08 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:09.734145 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-0312b49b-4313-4ae9-95f3-6616bc60645b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:09.735539 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-0312b49b-4313-4ae9-95f3-6616bc60645b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:09.742612 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0312b49b-4313-4ae9-95f3-6616bc60645b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:09.743097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0312b49b-4313-4ae9-95f3-6616bc60645b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:09.743530 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0312b49b-4313-4ae9-95f3-6616bc60645b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:09.744223 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0312b49b-4313-4ae9-95f3-6616bc60645b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:09.744698 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0312b49b-4313-4ae9-95f3-6616bc60645b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:09.745117 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-0312b49b-4313-4ae9-95f3-6616bc60645b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:09.885768 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-0312b49b-4313-4ae9-95f3-6616bc60645b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:09.894438 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-0312b49b-4313-4ae9-95f3-6616bc60645b tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1318 microversion: 2.1 time: 0.166651 Aug 24 16:56:09.895242 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 556/1106] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:09 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:10.917746 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6b4c9c7e-09d2-43a7-961d-d616815fe955 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:10.918367 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6b4c9c7e-09d2-43a7-961d-d616815fe955 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:10.925157 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b4c9c7e-09d2-43a7-961d-d616815fe955 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:10.925647 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b4c9c7e-09d2-43a7-961d-d616815fe955 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:10.926082 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b4c9c7e-09d2-43a7-961d-d616815fe955 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:10.926786 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b4c9c7e-09d2-43a7-961d-d616815fe955 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:10.927243 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b4c9c7e-09d2-43a7-961d-d616815fe955 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:10.927668 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b4c9c7e-09d2-43a7-961d-d616815fe955 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:11.069508 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6b4c9c7e-09d2-43a7-961d-d616815fe955 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:11.077599 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6b4c9c7e-09d2-43a7-961d-d616815fe955 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1506 microversion: 2.1 time: 0.164841 Aug 24 16:56:11.078170 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 551/1107] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:10 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:11.097836 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-1c26f6e2-a7aa-42a3-a6a8-55555bb08516 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4dcc67f-2743-4ec8-afb7-5aaa75622862", "device": "/dev/sdb"}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:56:11.100267 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-1c26f6e2-a7aa-42a3-a6a8-55555bb08516 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:11.107291 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1c26f6e2-a7aa-42a3-a6a8-55555bb08516 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:11.107769 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1c26f6e2-a7aa-42a3-a6a8-55555bb08516 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:11.108199 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1c26f6e2-a7aa-42a3-a6a8-55555bb08516 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:11.109097 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1c26f6e2-a7aa-42a3-a6a8-55555bb08516 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:11.109692 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1c26f6e2-a7aa-42a3-a6a8-55555bb08516 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:11.110112 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-1c26f6e2-a7aa-42a3-a6a8-55555bb08516 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:11.977921 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-1c26f6e2-a7aa-42a3-a6a8-55555bb08516 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "POST /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.883799 Aug 24 16:56:11.978572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 557/1108] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 16:56:11 2022] POST /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d/os-volume_attachments => generated 194 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:56:32.227976 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5b55731c-6d20-443c-a873-842faefdfeda tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:32.228592 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5b55731c-6d20-443c-a873-842faefdfeda tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:32.231158 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=11 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:32.231869 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=62 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:32.237134 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b55731c-6d20-443c-a873-842faefdfeda tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:32.237667 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b55731c-6d20-443c-a873-842faefdfeda tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:32.238163 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b55731c-6d20-443c-a873-842faefdfeda tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:32.238859 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b55731c-6d20-443c-a873-842faefdfeda tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:32.239314 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b55731c-6d20-443c-a873-842faefdfeda tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:32.239739 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b55731c-6d20-443c-a873-842faefdfeda tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:32.330643 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-5b55731c-6d20-443c-a873-842faefdfeda tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lazy-loading 'services' on Instance uuid 4a693f69-508b-4433-8628-9d929eb2507d {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:56:32.623855 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5b55731c-6d20-443c-a873-842faefdfeda tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d/os-volume_attachments/a4dcc67f-2743-4ec8-afb7-5aaa75622862" status: 202 len: 0 microversion: 2.1 time: 0.399833 Aug 24 16:56:32.624652 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 552/1109] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 16:56:32 2022] DELETE /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d/os-volume_attachments/a4dcc67f-2743-4ec8-afb7-5aaa75622862 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:56:33.747941 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=11 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:33.748761 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:33.752798 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2d10ed98-6f54-4226-9bc2-f8e3b42f6e51 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:33.753390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2d10ed98-6f54-4226-9bc2-f8e3b42f6e51 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:33.759728 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d10ed98-6f54-4226-9bc2-f8e3b42f6e51 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:33.760214 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d10ed98-6f54-4226-9bc2-f8e3b42f6e51 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:33.760707 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d10ed98-6f54-4226-9bc2-f8e3b42f6e51 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:33.761406 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d10ed98-6f54-4226-9bc2-f8e3b42f6e51 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:33.761869 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d10ed98-6f54-4226-9bc2-f8e3b42f6e51 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:33.762329 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2d10ed98-6f54-4226-9bc2-f8e3b42f6e51 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:33.789449 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2d10ed98-6f54-4226-9bc2-f8e3b42f6e51 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Going to try to terminate instance {{(pid=127626) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:56:34.187399 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2d10ed98-6f54-4226-9bc2-f8e3b42f6e51 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 204 len: 0 microversion: 2.1 time: 0.440597 Aug 24 16:56:34.188240 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 558/1110] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:56:33 2022] DELETE /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:34.197768 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-466e47f9-484a-4327-aa45-6c189aaa34f3 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:34.198467 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-466e47f9-484a-4327-aa45-6c189aaa34f3 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:34.204965 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-466e47f9-484a-4327-aa45-6c189aaa34f3 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:34.205444 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-466e47f9-484a-4327-aa45-6c189aaa34f3 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:34.205874 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-466e47f9-484a-4327-aa45-6c189aaa34f3 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:34.206565 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-466e47f9-484a-4327-aa45-6c189aaa34f3 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:34.207016 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-466e47f9-484a-4327-aa45-6c189aaa34f3 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:34.207434 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-466e47f9-484a-4327-aa45-6c189aaa34f3 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:34.341919 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-466e47f9-484a-4327-aa45-6c189aaa34f3 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:34.349723 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-466e47f9-484a-4327-aa45-6c189aaa34f3 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1512 microversion: 2.1 time: 0.157326 Aug 24 16:56:34.350914 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 553/1111] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:34 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:35.372590 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-215ef88f-17e8-408c-8d81-5da637251e97 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:35.373290 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-215ef88f-17e8-408c-8d81-5da637251e97 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:35.380052 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-215ef88f-17e8-408c-8d81-5da637251e97 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:35.380568 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-215ef88f-17e8-408c-8d81-5da637251e97 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:35.381017 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-215ef88f-17e8-408c-8d81-5da637251e97 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:35.381774 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-215ef88f-17e8-408c-8d81-5da637251e97 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:35.382227 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-215ef88f-17e8-408c-8d81-5da637251e97 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:35.382646 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-215ef88f-17e8-408c-8d81-5da637251e97 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:35.530365 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-215ef88f-17e8-408c-8d81-5da637251e97 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:35.538992 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-215ef88f-17e8-408c-8d81-5da637251e97 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1512 microversion: 2.1 time: 0.170927 Aug 24 16:56:35.539570 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 559/1112] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:35 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:56:36.414596 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-f4dd62e3-b45e-4b8f-bc1e-276293a03f98 req-c2042c31-7456-47a4-aef0-42fe4e9a970d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a693f69-508b-4433-8628-9d929eb2507d", "name": "network-vif-deleted", "tag": "136ca553-7d2d-4c1a-aed6-8831c99be33d"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:56:36.426164 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-f4dd62e3-b45e-4b8f-bc1e-276293a03f98 req-c2042c31-7456-47a4-aef0-42fe4e9a970d service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:36.429978 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-f4dd62e3-b45e-4b8f-bc1e-276293a03f98 req-c2042c31-7456-47a4-aef0-42fe4e9a970d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:36.429978 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-f4dd62e3-b45e-4b8f-bc1e-276293a03f98 req-c2042c31-7456-47a4-aef0-42fe4e9a970d service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:36.440870 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-f4dd62e3-b45e-4b8f-bc1e-276293a03f98 req-c2042c31-7456-47a4-aef0-42fe4e9a970d service nova] Creating event network-vif-deleted:136ca553-7d2d-4c1a-aed6-8831c99be33d for instance 4a693f69-508b-4433-8628-9d929eb2507d on hv-cinder-73116 Aug 24 16:56:36.447372 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-f4dd62e3-b45e-4b8f-bc1e-276293a03f98 req-c2042c31-7456-47a4-aef0-42fe4e9a970d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036747 Aug 24 16:56:36.447544 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 554/1113] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:56:36.561149 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-f0bd76ee-268d-4acb-bb6e-857915a811c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:36.561715 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-f0bd76ee-268d-4acb-bb6e-857915a811c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:36.569355 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0bd76ee-268d-4acb-bb6e-857915a811c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:36.582689 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0bd76ee-268d-4acb-bb6e-857915a811c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:36.582689 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0bd76ee-268d-4acb-bb6e-857915a811c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:36.582689 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0bd76ee-268d-4acb-bb6e-857915a811c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:36.582689 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0bd76ee-268d-4acb-bb6e-857915a811c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:36.583112 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-f0bd76ee-268d-4acb-bb6e-857915a811c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:36.641567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-f0bd76ee-268d-4acb-bb6e-857915a811c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5854a29681034733b989bf8c8bc59842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6157140b76496d8d6d05bfff3a9121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:36.649639 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-f0bd76ee-268d-4acb-bb6e-857915a811c9 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 200 len: 1303 microversion: 2.1 time: 0.092581 Aug 24 16:56:36.650565 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 560/1114] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:36 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:37.676935 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:37.678199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] [instance: 4a693f69-508b-4433-8628-9d929eb2507d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:37.686752 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:37.687247 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:37.687712 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:37.688568 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:37.689025 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:37.689450 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:37.707924 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] HTTP exception thrown: Instance 4a693f69-508b-4433-8628-9d929eb2507d could not be found. Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Request method failure captured: Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d HTTP/1.1 Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBlfQPqCKFGdY77MMpN23rHeY0cU4bBEwmJ0YfvMdNAC9X2_oNoHylRGYIV6i8mNCufvaoZoit4bldCZqB7F-x_131ZUVunSag63Uamwl5zEyrqIMkkOzhDPaMuckn8tF-xsz6g8onOZ-AmuPYR_ZMahe8xPF9YAAwQy4MQI2OghbJVQ Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: 0c6157140b76496d8d6d05bfff3a9121 Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesSnapshotTestJSON-345344012 Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:56:37.710900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0c6157140b76496d8d6d05bfff3a9121"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6157140b76496d8d6d05bfff3a9121"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0c6157140b76496d8d6d05bfff3a9121", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c6157140b76496d8d6d05bfff3a9121"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesSnapshotTestJSON-345344012 Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 0c6157140b76496d8d6d05bfff3a9121 Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-345344012 Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesSnapshotTestJSON-345344012-project Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: 5854a29681034733b989bf8c8bc59842 Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesSnapshotTestJSON-345344012-project Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 4a693f69-508b-4433-8628-9d929eb2507d could not be found. Aug 24 16:56:37.712766 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '4a693f69-508b-4433-8628-9d929eb2507d'} Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a693f69-508b-4433-8628-9d929eb2507d could not be found. Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:56:37.713805 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a693f69-508b-4433-8628-9d929eb2507d could not be found. Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a693f69-508b-4433-8628-9d929eb2507d could not be found. Aug 24 16:56:37.715537 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:56:37.717060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] Returning 404 to user: Instance 4a693f69-508b-4433-8628-9d929eb2507d could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:56:37.717060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e4d2f290-a842-4219-9f03-10d83a417463 tempest-VolumesSnapshotTestJSON-345344012 tempest-VolumesSnapshotTestJSON-345344012-project] 10.222.0.17 "GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d" status: 404 len: 111 microversion: 2.1 time: 0.044218 Aug 24 16:56:37.717060 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 555/1115] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:37 2022] GET /compute/v2.1/servers/4a693f69-508b-4433-8628-9d929eb2507d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:57:23.907136 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:57:23.907826 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Wed Aug 24 16:57:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:57:51.310806 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:51.312069 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:51.316002 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-912393061", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1100356887", "security_groups": [{"name": "tempest-secgroup-smoke-1875641850"}], "block_device_mapping_v2": [{"uuid": "a4184052-94a3-484e-86da-1d1a989443b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a598ee64-8390-470b-8704-7686a7a90fa6"}]}} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:51.451858 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.network.neutron [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] validate_networks() for [('a598ee64-8390-470b-8704-7686a7a90fa6', None, None, None, None, None)] {{(pid=127626) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:57:51.851950 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Flavor limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:57:51.852442 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Image limits 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:57:51.852946 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Flavor pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:57:51.853355 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Image pref 0:0:0 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:57:51.853773 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.virt.hardware [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:57:51.862748 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:51.863230 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:51.863664 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:51.864421 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:51.864882 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:51.865306 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:51.882446 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Getting quotas for project f18db8d724d4436cb1721859066ac74d. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:57:51.886460 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.quota [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Getting quotas for user aaa4ddbee1034946a1f4dfe751a2b5cd and project f18db8d724d4436cb1721859066ac74d. Resources: {'instances', 'cores', 'ram'} {{(pid=127626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:57:51.947213 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Going to run 1 instances... {{(pid=127626) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:57:51.949579 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a4184052-94a3-484e-86da-1d1a989443b0',volume_size=None,volume_type=None)] {{(pid=127626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:57:52.375996 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-96a390a4-c0ad-4d38-b6f0-68b9f2b12638 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.066797 Aug 24 16:57:52.376981 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 561/1116] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 16:57:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:57:52.385615 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=8 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:52.386368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:52.390462 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cbc129d6-f911-4abb-b227-9a0ffaeb5782 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:52.391243 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cbc129d6-f911-4abb-b227-9a0ffaeb5782 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:52.448354 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cbc129d6-f911-4abb-b227-9a0ffaeb5782 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:52.456426 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cbc129d6-f911-4abb-b227-9a0ffaeb5782 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1094 microversion: 2.1 time: 0.072598 Aug 24 16:57:52.457032 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 556/1117] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:52 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:53.477902 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-51ec7aae-6ad4-4b39-a163-037145626d92 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:53.478707 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-51ec7aae-6ad4-4b39-a163-037145626d92 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:53.485593 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51ec7aae-6ad4-4b39-a163-037145626d92 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:53.486162 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51ec7aae-6ad4-4b39-a163-037145626d92 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:53.486602 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51ec7aae-6ad4-4b39-a163-037145626d92 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:53.487313 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51ec7aae-6ad4-4b39-a163-037145626d92 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:53.487770 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51ec7aae-6ad4-4b39-a163-037145626d92 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:53.488194 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-51ec7aae-6ad4-4b39-a163-037145626d92 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:53.556069 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-51ec7aae-6ad4-4b39-a163-037145626d92 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:53.564468 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-51ec7aae-6ad4-4b39-a163-037145626d92 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1144 microversion: 2.1 time: 0.091107 Aug 24 16:57:53.565058 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 562/1118] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:53 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:54.586149 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c4332217-c864-405b-891f-aef269b7b9e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:54.587395 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c4332217-c864-405b-891f-aef269b7b9e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:54.595554 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4332217-c864-405b-891f-aef269b7b9e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:54.596044 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4332217-c864-405b-891f-aef269b7b9e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:54.596525 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4332217-c864-405b-891f-aef269b7b9e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:54.597249 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4332217-c864-405b-891f-aef269b7b9e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:54.597689 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4332217-c864-405b-891f-aef269b7b9e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:54.598235 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4332217-c864-405b-891f-aef269b7b9e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:54.702128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c4332217-c864-405b-891f-aef269b7b9e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:54.710404 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c4332217-c864-405b-891f-aef269b7b9e9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1200 microversion: 2.1 time: 0.128258 Aug 24 16:57:54.710993 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 557/1119] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:54 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1200 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:55.731320 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-49599090-8108-43c2-8d5b-160086732816 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:55.731884 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-49599090-8108-43c2-8d5b-160086732816 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:55.739186 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49599090-8108-43c2-8d5b-160086732816 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:55.739922 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49599090-8108-43c2-8d5b-160086732816 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:55.740375 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49599090-8108-43c2-8d5b-160086732816 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:55.741064 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49599090-8108-43c2-8d5b-160086732816 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:55.741511 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49599090-8108-43c2-8d5b-160086732816 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:55.741929 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-49599090-8108-43c2-8d5b-160086732816 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:55.931674 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-49599090-8108-43c2-8d5b-160086732816 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:55.940171 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-49599090-8108-43c2-8d5b-160086732816 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1278 microversion: 2.1 time: 0.212891 Aug 24 16:57:55.940785 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 563/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:55 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:56.306999 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-c4928e71-829c-4ccd-a149-ee8e72b12146 req-f241b770-5b77-4780-9604-a6c3e92cafeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2869f57-1e4b-44b8-b99c-9a8c3e942bc7", "tag": "f2b1e3a5-dd97-4aa7-bcc2-ec89b503bb72"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:56.320930 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-c4928e71-829c-4ccd-a149-ee8e72b12146 req-f241b770-5b77-4780-9604-a6c3e92cafeb service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:56.321410 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-c4928e71-829c-4ccd-a149-ee8e72b12146 req-f241b770-5b77-4780-9604-a6c3e92cafeb service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:56.321840 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-c4928e71-829c-4ccd-a149-ee8e72b12146 req-f241b770-5b77-4780-9604-a6c3e92cafeb service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:56.334151 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-c4928e71-829c-4ccd-a149-ee8e72b12146 req-f241b770-5b77-4780-9604-a6c3e92cafeb service nova] Creating event network-changed:f2b1e3a5-dd97-4aa7-bcc2-ec89b503bb72 for instance e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 on hv-cinder-73116 Aug 24 16:57:56.339205 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-c4928e71-829c-4ccd-a149-ee8e72b12146 req-f241b770-5b77-4780-9604-a6c3e92cafeb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035792 Aug 24 16:57:56.340109 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 558/1121] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:56.961318 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e58aa481-3fee-4d65-b67e-1bba0df11491 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:56.961927 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e58aa481-3fee-4d65-b67e-1bba0df11491 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:56.968524 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e58aa481-3fee-4d65-b67e-1bba0df11491 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:56.969022 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e58aa481-3fee-4d65-b67e-1bba0df11491 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:56.970352 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e58aa481-3fee-4d65-b67e-1bba0df11491 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:56.971063 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e58aa481-3fee-4d65-b67e-1bba0df11491 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:56.971518 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e58aa481-3fee-4d65-b67e-1bba0df11491 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:56.971955 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e58aa481-3fee-4d65-b67e-1bba0df11491 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:57.132473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e58aa481-3fee-4d65-b67e-1bba0df11491 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:57.140526 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e58aa481-3fee-4d65-b67e-1bba0df11491 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1266 microversion: 2.1 time: 0.182997 Aug 24 16:57:57.142333 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 564/1122] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:56 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:58.164546 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-97e5b8c7-55aa-46df-a090-e69b233ebfa4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:58.165249 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-97e5b8c7-55aa-46df-a090-e69b233ebfa4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:58.171878 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-97e5b8c7-55aa-46df-a090-e69b233ebfa4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:58.172397 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-97e5b8c7-55aa-46df-a090-e69b233ebfa4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:58.172847 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-97e5b8c7-55aa-46df-a090-e69b233ebfa4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:58.174222 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-97e5b8c7-55aa-46df-a090-e69b233ebfa4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:58.175538 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-97e5b8c7-55aa-46df-a090-e69b233ebfa4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:58.175981 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-97e5b8c7-55aa-46df-a090-e69b233ebfa4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:58.322027 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-97e5b8c7-55aa-46df-a090-e69b233ebfa4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:58.330000 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-97e5b8c7-55aa-46df-a090-e69b233ebfa4 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1266 microversion: 2.1 time: 0.169818 Aug 24 16:57:58.330731 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 559/1123] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:58 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:59.351598 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-2fc931ed-2c18-4677-a24e-165cb55e34b1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:59.352201 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-2fc931ed-2c18-4677-a24e-165cb55e34b1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:59.358567 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fc931ed-2c18-4677-a24e-165cb55e34b1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:59.359048 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fc931ed-2c18-4677-a24e-165cb55e34b1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:59.359479 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fc931ed-2c18-4677-a24e-165cb55e34b1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:59.360168 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fc931ed-2c18-4677-a24e-165cb55e34b1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:59.360653 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fc931ed-2c18-4677-a24e-165cb55e34b1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:59.361225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-2fc931ed-2c18-4677-a24e-165cb55e34b1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:59.505544 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-2fc931ed-2c18-4677-a24e-165cb55e34b1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:59.513358 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-2fc931ed-2c18-4677-a24e-165cb55e34b1 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1266 microversion: 2.1 time: 0.165728 Aug 24 16:57:59.513914 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 565/1124] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:59 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:00.534055 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-df63b84c-a361-41db-8eeb-7ab8cfb236cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:00.534785 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-df63b84c-a361-41db-8eeb-7ab8cfb236cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:00.541389 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df63b84c-a361-41db-8eeb-7ab8cfb236cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:00.541877 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df63b84c-a361-41db-8eeb-7ab8cfb236cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:00.542485 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df63b84c-a361-41db-8eeb-7ab8cfb236cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:00.543184 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df63b84c-a361-41db-8eeb-7ab8cfb236cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:00.543634 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df63b84c-a361-41db-8eeb-7ab8cfb236cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:00.544052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df63b84c-a361-41db-8eeb-7ab8cfb236cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:00.681261 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-df63b84c-a361-41db-8eeb-7ab8cfb236cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:00.690160 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-df63b84c-a361-41db-8eeb-7ab8cfb236cd tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1266 microversion: 2.1 time: 0.160203 Aug 24 16:58:00.690790 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 560/1125] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:00 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:01.711053 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-91cdd861-151b-44e9-991f-846df9622f81 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:01.711612 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-91cdd861-151b-44e9-991f-846df9622f81 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:01.718261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91cdd861-151b-44e9-991f-846df9622f81 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:01.718745 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91cdd861-151b-44e9-991f-846df9622f81 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:01.719182 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91cdd861-151b-44e9-991f-846df9622f81 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:01.719869 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91cdd861-151b-44e9-991f-846df9622f81 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:01.720320 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91cdd861-151b-44e9-991f-846df9622f81 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:01.720771 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-91cdd861-151b-44e9-991f-846df9622f81 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:01.872497 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=2 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:01.894387 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell0:SELECT=6 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:02.125866 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-91cdd861-151b-44e9-991f-846df9622f81 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:02.130571 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-91cdd861-151b-44e9-991f-846df9622f81 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1266 microversion: 2.1 time: 0.423378 Aug 24 16:58:02.131163 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 566/1126] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:01 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1266 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:03.149111 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:03.153481 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a3fa6383-a20b-469f-a4b6-9524f1297589 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:03.154093 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a3fa6383-a20b-469f-a4b6-9524f1297589 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:03.160570 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3fa6383-a20b-469f-a4b6-9524f1297589 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:03.161108 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3fa6383-a20b-469f-a4b6-9524f1297589 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:03.161554 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3fa6383-a20b-469f-a4b6-9524f1297589 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:03.162266 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3fa6383-a20b-469f-a4b6-9524f1297589 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:03.162723 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3fa6383-a20b-469f-a4b6-9524f1297589 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:03.163187 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3fa6383-a20b-469f-a4b6-9524f1297589 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:03.304269 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a3fa6383-a20b-469f-a4b6-9524f1297589 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:03.312568 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a3fa6383-a20b-469f-a4b6-9524f1297589 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1266 microversion: 2.1 time: 0.164891 Aug 24 16:58:03.313128 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 561/1127] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:03 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:04.332987 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-e731703d-37ac-4499-af93-3e2d61b28ad2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:04.333612 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-e731703d-37ac-4499-af93-3e2d61b28ad2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:04.346131 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e731703d-37ac-4499-af93-3e2d61b28ad2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:04.346654 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e731703d-37ac-4499-af93-3e2d61b28ad2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:04.347114 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e731703d-37ac-4499-af93-3e2d61b28ad2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:04.347825 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e731703d-37ac-4499-af93-3e2d61b28ad2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:04.348276 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e731703d-37ac-4499-af93-3e2d61b28ad2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:04.348731 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-e731703d-37ac-4499-af93-3e2d61b28ad2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:04.492275 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-e731703d-37ac-4499-af93-3e2d61b28ad2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:04.501411 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-e731703d-37ac-4499-af93-3e2d61b28ad2 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1266 microversion: 2.1 time: 0.172178 Aug 24 16:58:04.502000 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 567/1128] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:04 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:05.523538 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7d7d36c0-381c-493f-9ab6-c1d4d8e959a8 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:05.524175 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7d7d36c0-381c-493f-9ab6-c1d4d8e959a8 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:05.531318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d7d36c0-381c-493f-9ab6-c1d4d8e959a8 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:05.531817 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d7d36c0-381c-493f-9ab6-c1d4d8e959a8 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:05.532230 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d7d36c0-381c-493f-9ab6-c1d4d8e959a8 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:05.533122 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d7d36c0-381c-493f-9ab6-c1d4d8e959a8 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:05.533573 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d7d36c0-381c-493f-9ab6-c1d4d8e959a8 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:05.533994 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d7d36c0-381c-493f-9ab6-c1d4d8e959a8 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:05.675815 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7d7d36c0-381c-493f-9ab6-c1d4d8e959a8 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:05.684657 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7d7d36c0-381c-493f-9ab6-c1d4d8e959a8 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1266 microversion: 2.1 time: 0.164845 Aug 24 16:58:05.685251 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 562/1129] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:05 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:06.704946 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-bc150f58-3f6b-4e17-9554-73f8b519e7cf tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:06.705838 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-bc150f58-3f6b-4e17-9554-73f8b519e7cf tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:06.712294 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc150f58-3f6b-4e17-9554-73f8b519e7cf tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:06.712810 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc150f58-3f6b-4e17-9554-73f8b519e7cf tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:06.714060 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc150f58-3f6b-4e17-9554-73f8b519e7cf tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:06.714779 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc150f58-3f6b-4e17-9554-73f8b519e7cf tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:06.715458 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc150f58-3f6b-4e17-9554-73f8b519e7cf tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:06.716675 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-bc150f58-3f6b-4e17-9554-73f8b519e7cf tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:06.728132 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-8cbb4c5e-d62f-40bc-9d1b-70eb62af2c28 req-8370597b-3584-4d9e-a875-2b2c7de8a3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2869f57-1e4b-44b8-b99c-9a8c3e942bc7", "name": "network-vif-plugged", "status": "completed", "tag": "f2b1e3a5-dd97-4aa7-bcc2-ec89b503bb72"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:58:06.739890 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-8cbb4c5e-d62f-40bc-9d1b-70eb62af2c28 req-8370597b-3584-4d9e-a875-2b2c7de8a3b0 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:06.740496 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-8cbb4c5e-d62f-40bc-9d1b-70eb62af2c28 req-8370597b-3584-4d9e-a875-2b2c7de8a3b0 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:06.741052 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-8cbb4c5e-d62f-40bc-9d1b-70eb62af2c28 req-8370597b-3584-4d9e-a875-2b2c7de8a3b0 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:06.753806 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-8cbb4c5e-d62f-40bc-9d1b-70eb62af2c28 req-8370597b-3584-4d9e-a875-2b2c7de8a3b0 service nova] Creating event network-vif-plugged:f2b1e3a5-dd97-4aa7-bcc2-ec89b503bb72 for instance e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 on hv-cinder-73116 Aug 24 16:58:06.758957 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-8cbb4c5e-d62f-40bc-9d1b-70eb62af2c28 req-8370597b-3584-4d9e-a875-2b2c7de8a3b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034998 Aug 24 16:58:06.759564 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 563/1130] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:58:06.879607 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-bc150f58-3f6b-4e17-9554-73f8b519e7cf tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:06.879607 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-bc150f58-3f6b-4e17-9554-73f8b519e7cf tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1266 microversion: 2.1 time: 0.178398 Aug 24 16:58:06.880043 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 568/1131] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:06 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:07.904241 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4ce287f3-f107-4301-b1b4-6bae400952c7 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:07.904241 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4ce287f3-f107-4301-b1b4-6bae400952c7 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:07.909019 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce287f3-f107-4301-b1b4-6bae400952c7 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:07.909509 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce287f3-f107-4301-b1b4-6bae400952c7 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:07.910018 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce287f3-f107-4301-b1b4-6bae400952c7 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:07.910710 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce287f3-f107-4301-b1b4-6bae400952c7 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:07.911222 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce287f3-f107-4301-b1b4-6bae400952c7 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:07.911703 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4ce287f3-f107-4301-b1b4-6bae400952c7 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:08.054023 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4ce287f3-f107-4301-b1b4-6bae400952c7 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:08.062649 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4ce287f3-f107-4301-b1b4-6bae400952c7 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1266 microversion: 2.1 time: 0.166191 Aug 24 16:58:08.063228 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 564/1132] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:07 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:09.083900 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-59f919b0-05a6-428f-a804-591d7d4f3384 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:09.084538 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-59f919b0-05a6-428f-a804-591d7d4f3384 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:09.091793 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59f919b0-05a6-428f-a804-591d7d4f3384 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:09.092281 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59f919b0-05a6-428f-a804-591d7d4f3384 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:09.092763 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59f919b0-05a6-428f-a804-591d7d4f3384 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:09.093504 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59f919b0-05a6-428f-a804-591d7d4f3384 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:09.093961 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59f919b0-05a6-428f-a804-591d7d4f3384 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:09.094406 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-59f919b0-05a6-428f-a804-591d7d4f3384 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:09.252089 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-59f919b0-05a6-428f-a804-591d7d4f3384 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:09.262486 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-59f919b0-05a6-428f-a804-591d7d4f3384 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1453 microversion: 2.1 time: 0.182354 Aug 24 16:58:09.263386 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 569/1133] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:09 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:09.283773 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-12c84125-cee4-454e-914b-2e6e9605da2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:09.284407 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-12c84125-cee4-454e-914b-2e6e9605da2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:09.291903 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12c84125-cee4-454e-914b-2e6e9605da2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:09.292681 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12c84125-cee4-454e-914b-2e6e9605da2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:09.293199 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12c84125-cee4-454e-914b-2e6e9605da2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:09.293908 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12c84125-cee4-454e-914b-2e6e9605da2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:09.294363 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12c84125-cee4-454e-914b-2e6e9605da2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:09.294786 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12c84125-cee4-454e-914b-2e6e9605da2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:09.440612 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-12c84125-cee4-454e-914b-2e6e9605da2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:09.449206 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-12c84125-cee4-454e-914b-2e6e9605da2b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1453 microversion: 2.1 time: 0.169335 Aug 24 16:58:09.449772 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 565/1134] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:09 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:11.655786 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-3887522a-bead-4ddd-b842-223698d58cf7 req-98ddd000-fafe-42a4-b7db-9d2746a95cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2869f57-1e4b-44b8-b99c-9a8c3e942bc7", "tag": "f2b1e3a5-dd97-4aa7-bcc2-ec89b503bb72"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:58:11.665657 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-3887522a-bead-4ddd-b842-223698d58cf7 req-98ddd000-fafe-42a4-b7db-9d2746a95cb0 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:11.666742 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-3887522a-bead-4ddd-b842-223698d58cf7 req-98ddd000-fafe-42a4-b7db-9d2746a95cb0 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:11.667151 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-3887522a-bead-4ddd-b842-223698d58cf7 req-98ddd000-fafe-42a4-b7db-9d2746a95cb0 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:11.681528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-3887522a-bead-4ddd-b842-223698d58cf7 req-98ddd000-fafe-42a4-b7db-9d2746a95cb0 service nova] Creating event network-changed:f2b1e3a5-dd97-4aa7-bcc2-ec89b503bb72 for instance e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 on hv-cinder-73116 Aug 24 16:58:11.688690 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-3887522a-bead-4ddd-b842-223698d58cf7 req-98ddd000-fafe-42a4-b7db-9d2746a95cb0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036269 Aug 24 16:58:11.689313 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 570/1135] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:26.163613 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:59:26.164838 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Wed Aug 24 16:59:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:59:43.866289 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:43.867051 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG dbcounter [-] [127626] Writing DB stats nova_cell1:SELECT=52 {{(pid=127626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:43.871397 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-5cc0bd8f-b84e-4986-b3cc-b9003f89148b req-7cd9591c-df05-4d25-802e-5291d2aa1b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2869f57-1e4b-44b8-b99c-9a8c3e942bc7", "tag": "f2b1e3a5-dd97-4aa7-bcc2-ec89b503bb72"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:43.873531 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=22 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:43.874323 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=46 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:43.878474 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1faabe03-712e-475b-a79a-48a3aa600e4c tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:43.878982 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1faabe03-712e-475b-a79a-48a3aa600e4c tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:43.889966 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1faabe03-712e-475b-a79a-48a3aa600e4c tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:43.890461 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1faabe03-712e-475b-a79a-48a3aa600e4c tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:43.890902 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1faabe03-712e-475b-a79a-48a3aa600e4c tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:43.891620 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1faabe03-712e-475b-a79a-48a3aa600e4c tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:43.897086 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1faabe03-712e-475b-a79a-48a3aa600e4c tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:43.897545 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1faabe03-712e-475b-a79a-48a3aa600e4c tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:43.902874 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-5cc0bd8f-b84e-4986-b3cc-b9003f89148b req-7cd9591c-df05-4d25-802e-5291d2aa1b38 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:43.905176 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-5cc0bd8f-b84e-4986-b3cc-b9003f89148b req-7cd9591c-df05-4d25-802e-5291d2aa1b38 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:43.907528 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-5cc0bd8f-b84e-4986-b3cc-b9003f89148b req-7cd9591c-df05-4d25-802e-5291d2aa1b38 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:43.917874 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-5cc0bd8f-b84e-4986-b3cc-b9003f89148b req-7cd9591c-df05-4d25-802e-5291d2aa1b38 service nova] Creating event network-changed:f2b1e3a5-dd97-4aa7-bcc2-ec89b503bb72 for instance e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 on hv-cinder-73116 Aug 24 16:59:43.923344 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-5cc0bd8f-b84e-4986-b3cc-b9003f89148b req-7cd9591c-df05-4d25-802e-5291d2aa1b38 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058893 Aug 24 16:59:43.925327 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 571/1136] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:43.932176 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1faabe03-712e-475b-a79a-48a3aa600e4c tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:59:44.280306 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1faabe03-712e-475b-a79a-48a3aa600e4c tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 204 len: 0 microversion: 2.1 time: 0.418621 Aug 24 16:59:44.281235 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 566/1137] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:59:43 2022] DELETE /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:59:44.294115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-ac29ab89-7752-4717-a29e-2b521210f8e0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:44.298948 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-ac29ab89-7752-4717-a29e-2b521210f8e0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:44.305022 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac29ab89-7752-4717-a29e-2b521210f8e0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:44.305610 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac29ab89-7752-4717-a29e-2b521210f8e0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:44.306171 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac29ab89-7752-4717-a29e-2b521210f8e0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:44.306985 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac29ab89-7752-4717-a29e-2b521210f8e0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:44.307522 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac29ab89-7752-4717-a29e-2b521210f8e0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:44.308028 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-ac29ab89-7752-4717-a29e-2b521210f8e0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:44.803660 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-ac29ab89-7752-4717-a29e-2b521210f8e0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:44.821032 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-ac29ab89-7752-4717-a29e-2b521210f8e0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1578 microversion: 2.1 time: 0.533175 Aug 24 16:59:44.822036 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 572/1138] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:44 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1578 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:45.855786 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9b91a916-b73d-444e-a5c6-1743a6c9ab66 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:45.856541 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9b91a916-b73d-444e-a5c6-1743a6c9ab66 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:45.863575 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b91a916-b73d-444e-a5c6-1743a6c9ab66 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:45.864079 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b91a916-b73d-444e-a5c6-1743a6c9ab66 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:45.864560 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b91a916-b73d-444e-a5c6-1743a6c9ab66 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:45.865263 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b91a916-b73d-444e-a5c6-1743a6c9ab66 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:45.865721 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b91a916-b73d-444e-a5c6-1743a6c9ab66 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:45.866145 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9b91a916-b73d-444e-a5c6-1743a6c9ab66 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:46.144900 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9b91a916-b73d-444e-a5c6-1743a6c9ab66 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:46.153885 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9b91a916-b73d-444e-a5c6-1743a6c9ab66 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1459 microversion: 2.1 time: 0.302374 Aug 24 16:59:46.154475 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 567/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:45 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1459 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:46.449478 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-fa548edf-6db2-4833-83af-463fe9d6526e req-4f8deb98-625f-43e7-ab8c-8008969d0c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2869f57-1e4b-44b8-b99c-9a8c3e942bc7", "name": "network-vif-deleted", "tag": "f2b1e3a5-dd97-4aa7-bcc2-ec89b503bb72"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:46.464261 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-fa548edf-6db2-4833-83af-463fe9d6526e req-4f8deb98-625f-43e7-ab8c-8008969d0c47 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:46.464785 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-fa548edf-6db2-4833-83af-463fe9d6526e req-4f8deb98-625f-43e7-ab8c-8008969d0c47 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:46.465288 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-fa548edf-6db2-4833-83af-463fe9d6526e req-4f8deb98-625f-43e7-ab8c-8008969d0c47 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:46.479014 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-fa548edf-6db2-4833-83af-463fe9d6526e req-4f8deb98-625f-43e7-ab8c-8008969d0c47 service nova] Creating event network-vif-deleted:f2b1e3a5-dd97-4aa7-bcc2-ec89b503bb72 for instance e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 on hv-cinder-73116 Aug 24 16:59:46.484844 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-fa548edf-6db2-4833-83af-463fe9d6526e req-4f8deb98-625f-43e7-ab8c-8008969d0c47 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041517 Aug 24 16:59:46.486735 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 573/1140] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:47.178368 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:47.179164 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:47.185804 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:47.186298 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:47.186738 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:47.187456 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:47.187917 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:47.188460 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:47.224268 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:47.224789 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:47.225416 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:47.225731 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lazy-loading 'fault' on Instance uuid e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:59:47.271610 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:47.281190 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0f92c5ad-2415-4c6b-95af-2f960aaf43b9 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 200 len: 1230 microversion: 2.1 time: 0.108200 Aug 24 16:59:47.281995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 568/1141] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:47 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:48.305325 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:48.306108 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: e2869f57-1e4b-44b8-b99c-9a8c3e942bc7] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:48.312204 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:48.312723 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:48.313157 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:48.314473 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:48.314930 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:48.315353 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:48.331882 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] HTTP exception thrown: Instance e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 could not be found. Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Request method failure captured: Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 HTTP/1.1 Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBldGURwsduxzzbx4Sxdp_K2tpAxY_NRMWHaABTphjFKxKPjyNaal1TeiD-UxQVtxJumve1piB6NLEg0g3vQ8LL-4r8nhB_IX7tsaCUgQYnFmjmWk2bRnZMbhjCpW8sK-x5CGyOiPVWhvPOtA56MUSkdtEBzlYeL--lyJWC9ECMBcRnY Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: f18db8d724d4436cb1721859066ac74d Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:59:48.333608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f18db8d724d4436cb1721859066ac74d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: f18db8d724d4436cb1721859066ac74d Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-TestVolumeBootPattern-659221413-project Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: aaa4ddbee1034946a1f4dfe751a2b5cd Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-TestVolumeBootPattern-659221413-project Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 could not be found. Aug 24 16:59:48.336304 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': 'e2869f57-1e4b-44b8-b99c-9a8c3e942bc7'} Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 could not be found. Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:48.337390 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 could not be found. Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 could not be found. Aug 24 16:59:48.339115 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:48.340833 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Returning 404 to user: Instance e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:48.340833 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-99c52f46-5c1f-40bb-8546-b92055b3e9c0 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7" status: 404 len: 111 microversion: 2.1 time: 0.034909 Aug 24 16:59:48.340833 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 574/1142] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:48 2022] GET /compute/v2.1/servers/e2869f57-1e4b-44b8-b99c-9a8c3e942bc7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:59:52.119843 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-b1c7d21a-d879-4cae-a147-f4ba7c30e4ad req-bacc0610-4645-42d3-8922-e5d027c9ab9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93aa8a9-96b8-4360-bb4d-36fa81f3b459", "tag": "db15a5f4-0c41-433b-9c1f-94e2e5f90555"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:52.126778 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-06ed62d9-a55c-43c8-b647-a2796e902cf6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:52.127485 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-06ed62d9-a55c-43c8-b647-a2796e902cf6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:52.134332 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06ed62d9-a55c-43c8-b647-a2796e902cf6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:52.134593 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b1c7d21a-d879-4cae-a147-f4ba7c30e4ad req-bacc0610-4645-42d3-8922-e5d027c9ab9b service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:52.134800 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06ed62d9-a55c-43c8-b647-a2796e902cf6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:52.135225 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b1c7d21a-d879-4cae-a147-f4ba7c30e4ad req-bacc0610-4645-42d3-8922-e5d027c9ab9b service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:52.135449 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06ed62d9-a55c-43c8-b647-a2796e902cf6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:52.136160 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06ed62d9-a55c-43c8-b647-a2796e902cf6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:52.136489 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b1c7d21a-d879-4cae-a147-f4ba7c30e4ad req-bacc0610-4645-42d3-8922-e5d027c9ab9b service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:52.136646 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06ed62d9-a55c-43c8-b647-a2796e902cf6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:52.137247 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-06ed62d9-a55c-43c8-b647-a2796e902cf6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:52.151082 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-b1c7d21a-d879-4cae-a147-f4ba7c30e4ad req-bacc0610-4645-42d3-8922-e5d027c9ab9b service nova] Creating event network-changed:db15a5f4-0c41-433b-9c1f-94e2e5f90555 for instance d93aa8a9-96b8-4360-bb4d-36fa81f3b459 on hv-cinder-73116 Aug 24 16:59:52.157854 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-b1c7d21a-d879-4cae-a147-f4ba7c30e4ad req-bacc0610-4645-42d3-8922-e5d027c9ab9b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040864 Aug 24 16:59:52.159110 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 575/1143] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:59:52.166131 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-06ed62d9-a55c-43c8-b647-a2796e902cf6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:59:52.461572 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-06ed62d9-a55c-43c8-b647-a2796e902cf6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 204 len: 0 microversion: 2.1 time: 0.348374 Aug 24 16:59:52.462349 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 569/1144] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:59:52 2022] DELETE /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:59:52.471552 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-8effc441-1e37-48ce-9944-c91202d2b465 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:52.472307 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-8effc441-1e37-48ce-9944-c91202d2b465 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:52.479354 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8effc441-1e37-48ce-9944-c91202d2b465 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:52.479848 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8effc441-1e37-48ce-9944-c91202d2b465 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:52.480330 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8effc441-1e37-48ce-9944-c91202d2b465 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:52.481355 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8effc441-1e37-48ce-9944-c91202d2b465 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:52.482001 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8effc441-1e37-48ce-9944-c91202d2b465 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:52.482436 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-8effc441-1e37-48ce-9944-c91202d2b465 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:52.625572 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.policy [None req-8effc441-1e37-48ce-9944-c91202d2b465 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127626) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:52.634414 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-8effc441-1e37-48ce-9944-c91202d2b465 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1578 microversion: 2.1 time: 0.167130 Aug 24 16:59:52.635006 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 576/1145] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:52 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:53.655924 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8ec1e1d4-31cd-4dd8-b5ae-61b5b9825eda tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:53.656646 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8ec1e1d4-31cd-4dd8-b5ae-61b5b9825eda tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:53.664858 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec1e1d4-31cd-4dd8-b5ae-61b5b9825eda tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:53.665403 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec1e1d4-31cd-4dd8-b5ae-61b5b9825eda tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:53.665845 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec1e1d4-31cd-4dd8-b5ae-61b5b9825eda tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:53.670133 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec1e1d4-31cd-4dd8-b5ae-61b5b9825eda tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:53.670133 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec1e1d4-31cd-4dd8-b5ae-61b5b9825eda tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:53.670133 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ec1e1d4-31cd-4dd8-b5ae-61b5b9825eda tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:53.846945 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8ec1e1d4-31cd-4dd8-b5ae-61b5b9825eda tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:53.854840 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8ec1e1d4-31cd-4dd8-b5ae-61b5b9825eda tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1578 microversion: 2.1 time: 0.203156 Aug 24 16:59:53.855419 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 570/1146] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:53 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1578 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:54.581562 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [req-b4e1b71b-d5c4-4c7f-92fb-786883a62949 req-18266a69-22d4-4a76-a8ba-c826943dd4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93aa8a9-96b8-4360-bb4d-36fa81f3b459", "name": "network-vif-deleted", "tag": "db15a5f4-0c41-433b-9c1f-94e2e5f90555"}]} {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:54.590982 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b4e1b71b-d5c4-4c7f-92fb-786883a62949 req-18266a69-22d4-4a76-a8ba-c826943dd4f1 service nova] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:54.591459 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b4e1b71b-d5c4-4c7f-92fb-786883a62949 req-18266a69-22d4-4a76-a8ba-c826943dd4f1 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:54.591891 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [req-b4e1b71b-d5c4-4c7f-92fb-786883a62949 req-18266a69-22d4-4a76-a8ba-c826943dd4f1 service nova] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:54.603042 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.compute.server_external_events [req-b4e1b71b-d5c4-4c7f-92fb-786883a62949 req-18266a69-22d4-4a76-a8ba-c826943dd4f1 service nova] Creating event network-vif-deleted:db15a5f4-0c41-433b-9c1f-94e2e5f90555 for instance d93aa8a9-96b8-4360-bb4d-36fa81f3b459 on hv-cinder-73116 Aug 24 16:59:54.607779 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [req-b4e1b71b-d5c4-4c7f-92fb-786883a62949 req-18266a69-22d4-4a76-a8ba-c826943dd4f1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091067 Aug 24 16:59:54.608723 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 577/1147] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 16:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:54.876270 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8852d9aa-2a8a-41cc-9546-65dc6cf7822b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:54.877625 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8852d9aa-2a8a-41cc-9546-65dc6cf7822b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:54.884808 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8852d9aa-2a8a-41cc-9546-65dc6cf7822b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:54.885307 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8852d9aa-2a8a-41cc-9546-65dc6cf7822b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:54.885923 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8852d9aa-2a8a-41cc-9546-65dc6cf7822b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:54.886822 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8852d9aa-2a8a-41cc-9546-65dc6cf7822b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:54.887946 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8852d9aa-2a8a-41cc-9546-65dc6cf7822b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:54.888578 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8852d9aa-2a8a-41cc-9546-65dc6cf7822b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:54.964879 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8852d9aa-2a8a-41cc-9546-65dc6cf7822b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa4ddbee1034946a1f4dfe751a2b5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18db8d724d4436cb1721859066ac74d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:54.978021 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8852d9aa-2a8a-41cc-9546-65dc6cf7822b tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 200 len: 1226 microversion: 2.1 time: 0.105291 Aug 24 16:59:54.979038 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 571/1148] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:54 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:56.013576 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:56.014439 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: d93aa8a9-96b8-4360-bb4d-36fa81f3b459] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:56.021185 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.021683 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.022119 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.022821 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.023283 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.023705 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.036980 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] HTTP exception thrown: Instance d93aa8a9-96b8-4360-bb4d-36fa81f3b459 could not be found. Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Request method failure captured: Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 HTTP/1.1 Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBldGURwsduxzzbx4Sxdp_K2tpAxY_NRMWHaABTphjFKxKPjyNaal1TeiD-UxQVtxJumve1piB6NLEg0g3vQ8LL-4r8nhB_IX7tsaCUgQYnFmjmWk2bRnZMbhjCpW8sK-x5CGyOiPVWhvPOtA56MUSkdtEBzlYeL--lyJWC9ECMBcRnY Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: f18db8d724d4436cb1721859066ac74d Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:59:56.038608 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f18db8d724d4436cb1721859066ac74d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: f18db8d724d4436cb1721859066ac74d Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-TestVolumeBootPattern-659221413-project Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: aaa4ddbee1034946a1f4dfe751a2b5cd Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-TestVolumeBootPattern-659221413-project Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance d93aa8a9-96b8-4360-bb4d-36fa81f3b459 could not be found. Aug 24 16:59:56.040498 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': 'd93aa8a9-96b8-4360-bb4d-36fa81f3b459'} Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93aa8a9-96b8-4360-bb4d-36fa81f3b459 could not be found. Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:56.041378 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93aa8a9-96b8-4360-bb4d-36fa81f3b459 could not be found. Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93aa8a9-96b8-4360-bb4d-36fa81f3b459 could not be found. Aug 24 16:59:56.042744 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.044033 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Returning 404 to user: Instance d93aa8a9-96b8-4360-bb4d-36fa81f3b459 could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:56.044033 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-40b3986a-d0ca-44bf-938a-da1c38cd3ba6 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459" status: 404 len: 111 microversion: 2.1 time: 0.031185 Aug 24 16:59:56.044033 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 578/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:56 2022] GET /compute/v2.1/servers/d93aa8a9-96b8-4360-bb4d-36fa81f3b459 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:59:56.632382 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:56.633326 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:56.639676 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.640168 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.640645 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.641345 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.642285 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.642818 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.656486 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] HTTP exception thrown: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Request method failure captured: Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb HTTP/1.1 Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept: application/json Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Connection: close Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Length: 0 Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Content-Type: application/json Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Host: 10.222.0.17 Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjBldGURwsduxzzbx4Sxdp_K2tpAxY_NRMWHaABTphjFKxKPjyNaal1TeiD-UxQVtxJumve1piB6NLEg0g3vQ8LL-4r8nhB_IX7tsaCUgQYnFmjmWk2bRnZMbhjCpW8sK-x5CGyOiPVWhvPOtA56MUSkdtEBzlYeL--lyJWC9ECMBcRnY Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Id: f18db8d724d4436cb1721859066ac74d Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Role: reader,member Aug 24 16:59:56.659318 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f18db8d724d4436cb1721859066ac74d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Id: f18db8d724d4436cb1721859066ac74d Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User: tempest-TestVolumeBootPattern-659221413-project Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Id: aaa4ddbee1034946a1f4dfe751a2b5cd Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-TestVolumeBootPattern-659221413-project Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: method: > Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: exception: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:59:56.661995 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: action_args: {'id': '3ebd3320-a313-4dca-ba4b-d104b45402bb'} Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:56.663659 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:59:56.665744 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.667258 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Returning 404 to user: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:56.667258 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9626469d-230b-48c6-8253-859a448618da tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 404 len: 111 microversion: 2.1 time: 0.032256 Aug 24 16:59:56.667258 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 572/1150] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 16:59:56 2022] DELETE /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:59:56.669510 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '>' {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:56.670149 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.compute.api [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] [instance: 3ebd3320-a313-4dca-ba4b-d104b45402bb] Fetching instance by UUID {{(pid=127626) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:56.678989 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.683455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.683455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.683455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Acquiring lock "71e4e370-270f-4755-88e8-eb334db50fce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.683455 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.683868 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG oslo_concurrency.lockutils [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Lock "71e4e370-270f-4755-88e8-eb334db50fce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.696232 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.wsgi [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] HTTP exception thrown: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Request method failure captured: Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: request: GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb HTTP/1.1 Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept: application/json Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Accept-Encoding: identity Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Connection: close Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Length: 0 Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Content-Type: application/json Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Host: 10.222.0.17 Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Openstack-System-Scope: None Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Auth-Token: gAAAAABjBldGURwsduxzzbx4Sxdp_K2tpAxY_NRMWHaABTphjFKxKPjyNaal1TeiD-UxQVtxJumve1piB6NLEg0g3vQ8LL-4r8nhB_IX7tsaCUgQYnFmjmWk2bRnZMbhjCpW8sK-x5CGyOiPVWhvPOtA56MUSkdtEBzlYeL--lyJWC9ECMBcRnY Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Id: None Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Domain-Name: None Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Identity-Status: Confirmed Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Is-Admin-Project: True Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Id: default Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Domain-Name: Default Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Id: f18db8d724d4436cb1721859066ac74d Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Project-Name: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Role: reader,member Aug 24 16:59:56.697802 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Roles: reader,member Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f18db8d724d4436cb1721859066ac74d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f18db8d724d4436cb1721859066ac74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Id: f18db8d724d4436cb1721859066ac74d Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-Tenant-Name: tempest-TestVolumeBootPattern-659221413 Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User: tempest-TestVolumeBootPattern-659221413-project Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Id: default Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Domain-Name: Default Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Id: aaa4ddbee1034946a1f4dfe751a2b5cd Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: X-User-Name: tempest-TestVolumeBootPattern-659221413-project Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: method: > Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: exception: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:59:56.699713 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: action_args: {'id': '3ebd3320-a313-4dca-ba4b-d104b45402bb'} Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: {{(pid=127626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:56.700594 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. Aug 24 16:59:56.702050 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: ERROR nova.api.openstack.wsgi Aug 24 16:59:56.703228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: DEBUG nova.api.openstack.wsgi [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Returning 404 to user: Instance 3ebd3320-a313-4dca-ba4b-d104b45402bb could not be found. {{(pid=127626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:56.703228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO nova.api.openstack.requestlog [None req-7cae1ef6-ea25-4565-8108-df270267c662 tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb" status: 404 len: 111 microversion: 2.1 time: 0.033483 Aug 24 16:59:56.703228 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: [pid: 127626|app: 0|req: 579/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:56 2022] GET /compute/v2.1/servers/3ebd3320-a313-4dca-ba4b-d104b45402bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:59:58.232857 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-789690de-bc82-405f-ad35-d3689010dc0e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] Calling method '.version_select at 0x7f06ac05e040>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:58.314221 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-789690de-bc82-405f-ad35-d3689010dc0e tempest-TestVolumeBootPattern-659221413 tempest-TestVolumeBootPattern-659221413-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1100356887" status: 202 len: 0 microversion: 2.1 time: 0.085176 Aug 24 16:59:58.314806 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 573/1152] 10.222.0.17 () {58 vars in 1263 bytes} [Wed Aug 24 16:59:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1100356887 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:01:06.107425 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:01:06.108519 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Wed Aug 24 17:01:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:02:23.917614 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:02:23.918224 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Wed Aug 24 17:02:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:02:46.172845 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:02:46.173465 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Wed Aug 24 17:02:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:02:59.276144 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:02:59.276836 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Wed Aug 24 17:02:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:03:02.730377 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:03:02.731001 dv-cinder-731167-2-iscsi devstack@n-api.service[127626]: Wed Aug 24 17:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:03:10.800295 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:03:10.801013 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Wed Aug 24 17:03:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:04:26.118495 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:04:26.119676 dv-cinder-731167-2-iscsi devstack@n-api.service[127627]: Wed Aug 24 17:04:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!